-- Logs begin at Mon 2022-05-16 17:40:53 UTC, end at Mon 2022-05-16 19:06:47 UTC. -- May 16 18:39:34.372568 dv-cinder-750782-22-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 18:39:34.380384 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 18:39:34.382384 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 18:39:34 2022] *** May 16 18:39:34.382384 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 18:39:34.382384 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 18:39:34.382384 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: nodename: dv-cinder-750782-22-iscsi May 16 18:39:34.382384 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: machine: x86_64 May 16 18:39:34.382384 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: clock source: unix May 16 18:39:34.382384 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: pcre jit disabled May 16 18:39:34.382384 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: detected number of CPU cores: 4 May 16 18:39:34.382951 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: current working directory: / May 16 18:39:34.382951 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: detected binary path: /usr/bin/uwsgi-core May 16 18:39:34.382951 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: your processes number limit is 47680 May 16 18:39:34.382951 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: your memory page size is 4096 bytes May 16 18:39:34.382951 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: detected max file descriptor number: 2048 May 16 18:39:34.382951 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: lock engine: pthread robust mutexes May 16 18:39:34.382951 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: thunder lock: enabled May 16 18:39:34.382951 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 18:39:34.382951 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 18:39:34.430566 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: Python main interpreter initialized at 0x561405df89c0 May 16 18:39:34.430566 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: python threads support enabled May 16 18:39:34.430566 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: your server socket listen backlog is limited to 100 connections May 16 18:39:34.430566 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: your mercy for graceful operations on workers is 90 seconds May 16 18:39:34.431246 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: mapped 403077 bytes (393 KB) for 2 cores May 16 18:39:34.431246 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: *** Operational MODE: preforking *** May 16 18:39:34.431479 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: *** uWSGI is running in multiple interpreter mode *** May 16 18:39:34.431479 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: spawned uWSGI master process (pid: 114537) May 16 18:39:34.431660 dv-cinder-750782-22-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 18:39:34.432491 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: spawned uWSGI worker 1 (pid: 114538, cores: 1) May 16 18:39:34.435754 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: spawned uWSGI worker 2 (pid: 114539, cores: 1) May 16 18:39:34.435754 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 18:39:35.672175 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 18:39:35.699322 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 18:39:36.409880 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:39:36.409880 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: from cryptography.utils import int_from_bytes May 16 18:39:36.410199 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:39:36.410199 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: from cryptography.utils import int_from_bytes May 16 18:39:36.421154 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:39:36.421154 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: from cryptography.utils import int_from_bytes May 16 18:39:36.421480 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:39:36.421480 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: from cryptography.utils import int_from_bytes May 16 18:39:39.020593 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 18:39:39.021266 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 18:39:39.021357 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 18:39:39.021704 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 18:39:39.021961 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 18:39:39.022350 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.022659 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 18:39:39.023030 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.023120 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 18:39:39.023200 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.023287 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.023431 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 18:39:39.023621 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.024042 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 18:39:39.024148 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.024360 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 18:39:39.024454 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.024743 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.024873 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.025075 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.025183 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.025340 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.025439 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.025656 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.025750 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.025981 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-750782-22-iscsi {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.026080 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.026307 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.026407 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.026615 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.026702 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.026929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.027024 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.027248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.027341 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.027510 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.027604 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.027859 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.027969 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.028187 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.028279 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-750782-22-iscsi {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.028512 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.028684 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.028826 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.029129 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.029245 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.029439 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.029549 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.029747 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.029851 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.030073 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.030183 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.030384 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.030477 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.030697 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.030887 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.031002 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.031213 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.031307 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.031510 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.031639 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.031915 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.032063 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.032201 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.032372 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-750782-22-iscsi {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.032502 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.032684 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.032777 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.033002 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.033161 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.033320 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.033452 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.034266 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.034483 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.034593 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.034860 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.034966 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-750782-22-iscsi {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.035180 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.035273 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.035510 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.035614 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.035867 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.035957 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.036182 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.036324 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.036516 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.036642 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.036840 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.036956 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.037165 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.037284 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.037492 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.037612 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.037799 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.037925 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.038112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.038257 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.038428 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.038583 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.038752 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.038907 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.039111 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.039424 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.039511 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.039754 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.039842 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.040073 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.040159 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.040393 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.040478 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.040719 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.040802 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.041031 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.041116 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.041285 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.041383 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.041542 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.041743 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.041869 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.041976 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.042192 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.042279 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.042505 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.042600 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.042820 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.042905 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.043075 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.043161 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.043330 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.043429 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.043654 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.043781 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.044007 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.044103 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.044322 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.044416 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.044639 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.044734 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.044954 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.045068 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.045269 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.045380 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.045581 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.045686 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.045891 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.045998 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.046201 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.046293 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.046512 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.046615 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.046836 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.046940 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.047144 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.047236 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.047469 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.047568 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.047803 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.047916 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.048117 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.048221 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.048442 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.048536 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.048764 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.048869 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.049111 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.049262 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.049434 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.049743 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.049995 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.050102 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.050329 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.050420 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.050644 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.050730 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.050916 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.051008 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.051219 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.051312 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.051529 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.051631 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.051875 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.051983 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.052186 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.052280 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.052493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.052587 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.052801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.052896 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.053103 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.053200 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.053377 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.053474 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.053686 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.053771 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.053997 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.054089 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.054306 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.054442 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.054612 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.054699 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.054916 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.055023 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.055228 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.055333 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.055531 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.055624 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.055861 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.055949 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.056184 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.056282 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.056505 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.056601 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.056811 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.056897 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.057120 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.057206 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.057424 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.057508 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.057732 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.057827 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.058037 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.058131 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.058345 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.058429 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.058651 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.058743 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.058971 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.059058 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.059276 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.059367 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.059581 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.059674 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.059915 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.060008 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.060229 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.060316 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.060533 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.060625 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.060854 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.060939 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.061152 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.061236 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.061459 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.061545 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.061769 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.061872 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.062074 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.062162 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.062380 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.062466 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.062684 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.062807 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.062988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.063112 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.063291 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.063378 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.063595 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.063682 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.063926 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.064014 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.064231 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.064324 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.064532 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.064617 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.064924 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.065200 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.065338 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.065529 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.065642 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.065838 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.065933 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.066143 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.066238 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.066453 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.066547 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.066764 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.066858 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.067074 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.067168 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.067382 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.067482 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.067731 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.067837 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.068053 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.068155 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.068367 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.068461 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.068680 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.068773 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.068993 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.069166 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.069324 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:39:39.069417 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.069650 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.069742 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.069971 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.070073 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.070287 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.070380 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.070603 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.070695 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.070926 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.071033 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.071248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.071341 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.071582 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.071675 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.071927 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.072085 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.072247 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.072346 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.072566 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.072657 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.072881 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.072992 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.073224 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.073321 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.073510 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.073612 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.073834 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.073926 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.074149 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.074243 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.074481 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.074595 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.074810 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.074908 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.075120 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.075215 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.075447 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.075539 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.075795 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.075954 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.076122 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.076390 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.076525 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.076729 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.076875 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.077063 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.077210 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.077388 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.077539 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.077740 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.077890 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.078075 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.078237 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.078392 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.078535 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.078689 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.078840 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.078974 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.079116 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.079299 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.079487 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.079763 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.079913 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.080072 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.080219 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.080850 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.080995 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.081133 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.081319 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.081448 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.081747 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.081886 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.082063 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.082308 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.082445 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.082549 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.082676 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.082765 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.082990 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.083096 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.083299 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.083385 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.083609 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.083695 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.083946 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.084036 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.084260 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.084348 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.084570 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.084658 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.084889 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.084974 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.085205 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.085298 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.085514 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.085608 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.085826 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.085913 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.086142 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.086234 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.086452 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.086549 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.086762 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.086848 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.087071 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.087155 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.087381 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.087475 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.087694 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.087925 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.088011 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.088260 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.088358 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.088577 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.088666 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.088915 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.089000 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.089228 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.089318 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.089542 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.089627 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.089848 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.089936 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.090153 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.090248 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.090462 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.090556 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.090776 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.090867 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.091087 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.091181 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.091663 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.091773 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.092007 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.092095 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.092320 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.092413 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.092634 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.092721 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.092964 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.093051 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.093274 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.093438 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.093583 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.093669 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.093900 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.093992 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.094212 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.094305 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.094525 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.094610 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.094840 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.094936 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.095155 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.095241 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.095480 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.095564 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.095811 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.095901 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.096805 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.097024 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.097149 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.097339 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.097476 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.097654 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.097791 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.097964 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.098121 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.098272 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.098452 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.098580 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.098778 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.098888 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.099090 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.099196 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.099406 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.099505 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.099727 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.099875 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.100051 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.100137 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.100363 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.100462 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.100677 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.100763 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.100990 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.101076 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.101299 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.101398 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.101607 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.101694 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.101917 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.102002 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.102228 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.102316 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.102557 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.102642 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.102870 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.102956 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.103186 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.103310 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.103545 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.103642 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.103851 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.103949 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.104167 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.104264 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.104481 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.104574 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.104804 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.104897 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.105117 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.105205 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.105437 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.105530 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.105749 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.105854 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.106075 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.106162 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.106389 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.106477 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.106703 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.106802 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.107011 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.107103 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.107325 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.107410 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.107643 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.107780 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.107997 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.108083 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.108313 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.108398 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.108636 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.108732 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.108949 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.109035 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.109267 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.109353 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.109580 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.109679 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.109891 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.109975 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.110203 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.110335 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.110518 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.110608 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.110838 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.110932 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.111150 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.111236 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.111474 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.111572 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.111861 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.111957 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.112211 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.112288 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.112526 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.112612 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.112846 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.112939 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.113154 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.113240 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.113471 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.113558 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.113799 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.113886 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.114120 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.114213 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.114433 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.114524 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.114747 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.114835 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.115060 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.115153 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.115374 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.115459 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.115687 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.115826 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.116023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.116122 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.116333 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.116431 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.116640 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.116726 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.116952 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.117045 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.117265 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.117352 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.117578 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.117672 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.117890 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.117978 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.118197 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.118290 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.118514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.118606 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.118824 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.118909 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.119129 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.119215 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.119436 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.119519 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.119765 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.119855 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.120083 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.120168 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.120394 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.120488 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.120708 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.120794 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.121023 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.121109 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.121333 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.121424 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.121640 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.121726 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.121952 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.122036 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.122260 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.122354 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.122566 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.122649 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.122873 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.122958 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.123182 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.123344 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.123496 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.123581 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.123847 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.123957 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.124157 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.124287 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.124475 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.124596 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.124797 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.124905 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.125109 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.125235 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.125422 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.125549 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.125731 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.125858 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.126041 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.126173 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.126364 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.126482 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.126676 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.126826 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.126985 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.127141 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.127335 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.127473 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.127817 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.127905 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.128154 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.128240 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.128466 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.128781 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.128866 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.129090 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.129287 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.129417 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.129562 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.129724 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.129852 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.130022 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.130260 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.130385 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.130634 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.130827 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.131209 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.131320 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.131547 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.131648 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.131891 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.131981 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.132213 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.132314 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.132536 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.132624 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.132857 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.132950 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.133180 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.133266 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.133498 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.133583 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.133815 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.133949 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.134126 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.134222 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.134437 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.134523 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.134746 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.134834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.135054 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.135312 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.135440 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.135653 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.135771 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.135985 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.136082 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.136292 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.136379 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.136604 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.136689 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.136909 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.136995 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.137212 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.137307 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.137518 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.137603 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.137825 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.137918 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.138137 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.138236 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.138440 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.138525 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.138750 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.138835 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.139053 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.139148 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.139375 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.139460 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.139684 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.139834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.140014 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.140118 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.140317 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.140411 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.140623 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.140708 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.140932 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.141018 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.141243 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.141328 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.141552 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.141637 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.141861 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.141948 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.142181 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.142268 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.142490 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.142575 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.143340 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.143431 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.143699 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.144055 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.144140 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.144375 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.144452 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.144688 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.144774 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.144999 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.145091 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.145310 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.145397 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.145659 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.145749 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.145971 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.146056 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.146281 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.146380 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.146592 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.146687 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.146903 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.146997 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.147215 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.147302 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.147521 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.147606 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.147863 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.147971 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.148172 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.148258 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.148486 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.148571 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.148797 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.148965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.149104 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.149191 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.149411 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.149496 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.149721 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.149815 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.150031 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.150117 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.150337 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.150429 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.150647 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.150741 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.150951 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.151037 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.151260 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.151344 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.151564 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.151650 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.151897 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.151982 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.152210 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.152294 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.152522 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.152618 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.152832 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.152962 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.153137 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.153222 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.153448 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.153534 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.153760 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.153844 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.154066 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.154158 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.154372 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.154458 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.154678 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.154763 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.154981 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.155077 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.155286 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.155371 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.155596 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.155680 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.155946 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.156047 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.156265 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.156352 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.156570 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.156660 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.156879 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.156973 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.157181 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.157273 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.157483 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.157577 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.157789 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.157888 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.158096 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.158186 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.158491 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.159090 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.159294 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.159463 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.159632 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.159800 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.159936 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.160112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.160266 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.160420 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.160593 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.160745 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.160906 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.161056 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.161223 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.161364 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.161534 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.161671 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.161844 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.161978 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.162154 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.162327 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.162467 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.162635 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.162777 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.162997 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.163084 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.163308 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.163402 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.163623 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.163721 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.163987 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.164075 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.164301 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.164395 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.164613 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.164699 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.164919 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.165005 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.165222 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.165307 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.165527 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.165611 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.165837 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.165932 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.166148 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.166234 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.166453 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.166602 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.166756 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.166844 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.167079 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.167165 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.167390 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.167484 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.167700 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.167832 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.168046 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.168131 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.168361 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.168457 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.168671 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.168757 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.168975 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.169059 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.169286 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.169385 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.169597 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.169694 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.169905 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.169998 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.170214 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.170309 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.170523 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.170609 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.170834 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.170918 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.171145 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.171238 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.171455 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.171540 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.171796 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.171897 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.172111 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.172204 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.172418 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.172513 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.172725 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.172810 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.173034 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.173167 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.173342 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.173429 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.173654 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.173738 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.173964 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.174081 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.174302 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.174395 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.174714 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.174807 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.175020 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.175106 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.175331 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.175417 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.175638 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.175746 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.176027 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.176112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.176344 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.176431 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.176673 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.176774 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.176982 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.177066 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.177293 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.177379 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.177601 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.177700 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.177909 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.177993 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.178221 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.178304 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.178527 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.178615 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.178837 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.178944 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.179148 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.179240 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.179551 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.179637 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.179886 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.179973 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.180193 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.180279 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.180498 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.180585 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.180809 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.180907 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.181120 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.181205 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.181422 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.181507 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.181725 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.181810 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.182028 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.182121 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.182404 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.182497 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.182663 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.182749 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.182986 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.183082 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.183355 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.183441 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.183665 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.183771 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.184005 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.184104 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.184319 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.184436 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.184646 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.184738 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.184954 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.185053 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.185262 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.185348 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.185570 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.185655 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.185904 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.185990 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.186213 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.186298 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.186539 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.186624 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.186863 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.186953 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.187187 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.187272 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.187511 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.187604 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.187847 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.187984 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.188162 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.188300 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.188466 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.188615 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.188790 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.188943 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.189111 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.189269 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.189413 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.189596 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.189819 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.190084 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.190289 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.190408 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.190629 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.190716 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.190943 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.191042 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.191265 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.191360 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.191589 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.191675 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.191922 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.192023 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.192237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.192323 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.192547 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.192632 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.192851 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.192955 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.193157 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.193246 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.193481 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.193570 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.193785 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.193937 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.194096 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.194266 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.194408 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.194583 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.194717 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.194908 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.195024 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.195238 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.195331 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.195550 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.195645 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.195891 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.196026 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.196208 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.196295 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.196519 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.196619 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.196831 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.196917 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.197160 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.197255 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.197470 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.197566 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.197786 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.197873 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.198096 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.198187 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.198404 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.198491 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.198707 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.198802 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.199013 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.199100 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.199340 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.199428 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.199648 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.199753 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.199997 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.200083 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.200313 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.200407 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.200647 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.200732 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.200961 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.201054 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.201270 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.201357 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.201596 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.201682 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.201910 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.202004 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.202220 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.202312 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.202526 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.202620 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.202833 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.202932 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.203138 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.203281 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.203446 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.203533 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.203770 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.203878 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.204077 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.204164 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.204381 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.204469 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.204689 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.204785 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.204994 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.205080 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.205869 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.205996 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.206335 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.206496 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.206661 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.206765 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.206971 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.207070 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.207290 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.207388 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.207599 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.207697 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.207933 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.208029 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.208241 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.208339 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.208548 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.208643 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.208857 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.208954 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.209170 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.209277 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.209479 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.209576 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.209784 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.209891 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.210090 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.210194 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.210421 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.210530 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.210729 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.210834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.211055 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.211151 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.211370 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.211468 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.211682 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.211811 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.212017 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.212114 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.212327 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.212425 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.212647 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.212752 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.212962 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.213060 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.213277 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.213375 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.213586 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.213684 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.213902 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.213998 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.214215 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.214312 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.214533 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.214628 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.214863 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.215055 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.215197 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.215386 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.215501 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.215701 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.215834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.216037 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.216155 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.216617 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.216725 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.216934 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.217049 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.217248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.217368 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.217558 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.217683 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.217873 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.218077 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.218174 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.218381 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.218483 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.218704 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.218791 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.219096 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.219235 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.219421 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.219586 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.219785 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.219888 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.220104 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.220211 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.220418 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.220530 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.220732 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.220851 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.221644 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.221809 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.222005 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.222130 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.222320 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.222461 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.222630 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.222749 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.222939 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.223026 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.223251 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.223335 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.223565 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.223766 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.223904 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.223991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.224215 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.224308 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.224530 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.224625 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.224841 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.224976 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.225152 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.225240 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.225461 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.225598 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.225771 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.225858 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.226082 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.226174 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.226403 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.226492 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.226727 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.226812 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.227062 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.227161 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.227356 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.227443 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.227668 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.227769 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.228008 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.228124 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.228331 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.228525 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.228650 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.228839 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.228968 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.229173 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.229268 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.229497 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.229583 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.229820 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.229906 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.230133 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.230221 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.230448 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.230535 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.230771 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.230865 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.231077 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.231164 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.231380 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.231467 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.231693 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.231846 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.232025 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.232288 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.232377 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.232606 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.232700 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.232945 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.233033 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.233248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.233340 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.233568 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.233655 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.233877 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.233965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.234198 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.234424 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.234511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.234770 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.234858 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.235084 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.235170 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.235410 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.235495 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.235742 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.235832 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.236065 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.236166 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.236374 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.236510 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.236751 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.237058 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.237364 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.237599 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.237685 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.237936 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.238030 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.238271 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.238356 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.238576 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.238663 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.238887 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.239128 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.239215 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.239488 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.239581 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.239818 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.239917 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.240125 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.240212 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.240451 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.240544 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.240758 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.240854 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.241063 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.241148 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.241366 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.241459 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.241677 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.241771 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.241979 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.242068 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.242281 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.242365 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.242589 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.242683 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.242890 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.242976 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.243197 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.243284 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.243501 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.243588 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.243833 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.243967 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.244138 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.244235 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.244448 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.244535 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.244751 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.244836 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.245058 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.245143 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.245392 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.245479 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.245706 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.245791 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.246008 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.246136 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.246311 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.246398 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.246621 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.246713 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.246929 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.247022 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.247239 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.247324 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.247546 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.247638 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.247885 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.247984 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.248197 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.248292 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.248513 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.248599 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.248823 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.249046 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.249133 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.249383 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.249475 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.249705 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.249875 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.250039 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.250174 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.250372 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.250461 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.250680 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.250774 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.250987 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.251073 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.251292 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.251384 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.251605 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.251699 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.251941 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.252083 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.252797 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.252902 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.253107 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.253243 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.253420 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.253508 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.253730 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.253825 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.254038 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.254349 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.254441 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.254659 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.254746 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.254967 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.255062 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.255275 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.255364 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.255585 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.255672 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.255922 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.256030 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.256236 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.256331 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.256576 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.256710 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.256896 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.256984 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.257211 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.257306 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.257524 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.257610 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.257840 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.257928 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.258150 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.258236 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.258459 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.258547 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.258768 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.258855 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.259075 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.259162 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.259387 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.259483 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.259702 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.259823 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.260051 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.260136 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.260359 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.260459 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.260668 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.260774 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.260986 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.261078 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.261331 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.261431 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.261654 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.261742 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.261974 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.262059 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.262293 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.262380 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.262614 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.262701 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.262928 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.263036 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.263244 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.263340 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.263552 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.263639 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.263899 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.263988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.264221 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.264309 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.264551 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.264635 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.264867 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.264960 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.265173 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.265258 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.265479 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.265582 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.265785 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.265881 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.266093 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.266203 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.266433 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.266534 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.266723 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.266818 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.267031 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.267142 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.267336 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.267468 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.267646 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.267866 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.268067 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.268200 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.268373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.268605 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.268700 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.268945 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.269041 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.269268 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.269352 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.269571 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.269665 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.269875 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.269962 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.270180 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.270272 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.270483 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.270578 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.270786 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.270873 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.271091 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.271176 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.271400 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.271487 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.271720 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.271808 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.272031 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.272129 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.272336 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.272426 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.272638 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.272724 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.272943 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.273027 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.273253 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.273341 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.273564 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.273717 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.273872 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.273960 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.274187 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.274276 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.274496 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.274582 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.274803 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.274898 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.275111 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.275199 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.275419 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.275514 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.275748 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.275853 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.276062 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.276149 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.276372 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.276458 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.276678 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.276772 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.276985 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.277072 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.277292 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.277388 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.277598 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.277694 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.277905 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.277990 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.278215 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.278308 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.278527 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.278615 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.278854 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.278941 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.279177 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.279263 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.279483 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.279571 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.279830 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.279929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.280146 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.280232 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.280465 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.280556 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.280782 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.280869 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.281093 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.281181 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.281406 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.281493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.281719 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.281804 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.282028 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.282128 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.282341 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.282435 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.282652 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.282738 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.282962 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.283056 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.283275 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.283362 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.284140 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.284237 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.284475 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.284603 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.284804 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.284938 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.285115 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.285255 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.285460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.285588 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.285788 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.285913 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.286136 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.286222 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.286451 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.286539 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.286796 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.286890 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.287125 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.287218 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.287440 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.287535 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.287774 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.287866 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.288084 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.288183 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.288326 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 18:39:39.288420 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.288706 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.289026 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.289345 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.289675 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.290006 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.290320 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.290649 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.290979 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.291330 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.291647 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.292020 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.292356 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.292677 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.292993 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.293307 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:39:39.293554 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 18:39:39.311724 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG oslo_db.sqlalchemy.engines [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:39:39.316930 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_db.sqlalchemy.engines [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:39:39.376261 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.context [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),84d05d0b-ae3d-4239-a9ae-52dba225be17(cell1) {{(pid=114539) load_cells /opt/stack/nova/nova/context.py:464}} May 16 18:39:39.380704 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.context [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),84d05d0b-ae3d-4239-a9ae-52dba225be17(cell1) {{(pid=114538) load_cells /opt/stack/nova/nova/context.py:464}} May 16 18:39:39.381115 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG oslo_concurrency.lockutils [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:39:39.382697 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG oslo_concurrency.lockutils [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:39:39.383481 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG oslo_concurrency.lockutils [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:39:39.384965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:39:39.385466 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG oslo_concurrency.lockutils [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:39:39.386534 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:39:39.387302 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:39:39.389262 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:39:39.397295 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG oslo_db.sqlalchemy.engines [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:39:39.400733 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG oslo_db.sqlalchemy.engines [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:39:39.404373 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_db.sqlalchemy.engines [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:39:39.407670 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_db.sqlalchemy.engines [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:39:39.561594 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG oslo_db.sqlalchemy.engines [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:39:39.569547 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_db.sqlalchemy.engines [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:39:39.903845 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: WARNING keystonemiddleware.auth_token [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:39:39.911244 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: WARNING keystonemiddleware.auth_token [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:39:39.913769 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: WARNING keystonemiddleware.auth_token [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:39:39.922153 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: WARNING keystonemiddleware.auth_token [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:39:40.256703 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: WARNING keystonemiddleware.auth_token [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:39:40.262711 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: WARNING keystonemiddleware.auth_token [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:39:40.268949 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561405df89c0 pid: 114538 (default app) May 16 18:39:40.270984 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:39:40.272191 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001739 May 16 18:39:40.272293 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: WARNING keystonemiddleware.auth_token [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:39:40.272654 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 788 bytes} [Mon May 16 18:39:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:39:40.278367 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: WARNING keystonemiddleware.auth_token [None req-3bbc45bc-6d44-4f73-ae49-f57ad1df8465 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:39:40.285085 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561405df89c0 pid: 114539 (default app) May 16 18:40:58.909283 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:40:58.910343 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 16 18:40:58.910891 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:40:59.349614 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-72377b66-ccb9-4a00-8024-1df8aa051713 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:40:59.380468 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-72377b66-ccb9-4a00-8024-1df8aa051713 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.462636 May 16 18:40:59.381870 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 1/3] 10.222.0.72 () {60 vars in 1291 bytes} [Mon May 16 18:40:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:41:01.702673 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:01.704916 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-54c190fc-1bb1-4cc5-8a48-723405f824e3 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002610 May 16 18:41:01.706293 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 3/4] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:01.769434 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-b9da5e53-451e-40d6-9ae8-4ebfd27fc3a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256}} {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:01.788349 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:41:01.788349 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: warnings.warn(msg) May 16 18:41:01.816241 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-b9da5e53-451e-40d6-9ae8-4ebfd27fc3a0 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104470 May 16 18:41:01.816822 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 2/5] 10.222.0.72 () {64 vars in 1282 bytes} [Mon May 16 18:41:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:41:02.053563 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-92a430c2-eabe-44b0-bf0a-74fd970f57dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:02.056024 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:41:02.056024 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: warnings.warn(msg) May 16 18:41:02.111339 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-92a430c2-eabe-44b0-bf0a-74fd970f57dc admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286508 May 16 18:41:02.112135 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 4/6] 10.222.0.72 () {64 vars in 1335 bytes} [Mon May 16 18:41:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:41:04.410423 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-b9da5e53-451e-40d6-9ae8-4ebfd27fc3a0 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:04.411422 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-b9da5e53-451e-40d6-9ae8-4ebfd27fc3a0 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 16 18:41:04.412370 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 3/7] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:04.522426 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-b5628576-ac3a-493c-862a-5ba17e269bb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "disk": 5, "name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:04.540362 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:41:04.540362 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: warnings.warn(msg) May 16 18:41:04.559954 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-b5628576-ac3a-493c-862a-5ba17e269bb8 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140473 May 16 18:41:04.560515 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 5/8] 10.222.0.72 () {64 vars in 1282 bytes} [Mon May 16 18:41:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:41:04.572657 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-ef982795-f7a8-4fa9-ba26-efd1b248d4f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:04.574141 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:41:04.574141 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: warnings.warn(msg) May 16 18:41:04.606284 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-ef982795-f7a8-4fa9-ba26-efd1b248d4f8 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037187 May 16 18:41:04.606784 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 4/9] 10.222.0.72 () {64 vars in 1335 bytes} [Mon May 16 18:41:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:41:06.893137 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-b5628576-ac3a-493c-862a-5ba17e269bb8 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:06.894150 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-b5628576-ac3a-493c-862a-5ba17e269bb8 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 16 18:41:06.894569 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:06.961743 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-ca4eb8ea-c54e-46a9-8d77-62a56b208336 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:06.982937 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-ca4eb8ea-c54e-46a9-8d77-62a56b208336 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082473 May 16 18:41:06.983577 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 5/11] 10.222.0.72 () {64 vars in 1282 bytes} [Mon May 16 18:41:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:41:06.995378 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-181c48ca-36d5-461c-a7dc-1f2c43a3671f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:07.019757 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-181c48ca-36d5-461c-a7dc-1f2c43a3671f admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027946 May 16 18:41:07.027834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 7/12] 10.222.0.72 () {64 vars in 1335 bytes} [Mon May 16 18:41:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:41:09.321318 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-ca4eb8ea-c54e-46a9-8d77-62a56b208336 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:09.322350 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-ca4eb8ea-c54e-46a9-8d77-62a56b208336 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 16 18:41:09.322973 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 6/13] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:09.385188 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-122c787e-f69c-4920-9f74-a8e2bc3feff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "vcpus": 2}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:09.403380 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-122c787e-f69c-4920-9f74-a8e2bc3feff1 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073526 May 16 18:41:09.404089 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 8/14] 10.222.0.72 () {64 vars in 1282 bytes} [Mon May 16 18:41:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:41:09.417040 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-39a432c6-901d-4017-ac0e-ab045a0a62db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:09.441452 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-39a432c6-901d-4017-ac0e-ab045a0a62db admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028218 May 16 18:41:09.442276 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 7/15] 10.222.0.72 () {64 vars in 1335 bytes} [Mon May 16 18:41:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:41:11.735898 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-122c787e-f69c-4920-9f74-a8e2bc3feff1 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:11.737499 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-122c787e-f69c-4920-9f74-a8e2bc3feff1 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002197 May 16 18:41:11.738067 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 9/16] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:11.797049 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-8b2f4f85-0c01-482c-9bd0-626919fd2032 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:11.818572 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-8b2f4f85-0c01-482c-9bd0-626919fd2032 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074882 May 16 18:41:11.819513 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 8/17] 10.222.0.72 () {64 vars in 1282 bytes} [Mon May 16 18:41:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:41:11.831733 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-b70e65ea-fe82-4797-b9e8-0b2081710e29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:11.857008 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-b70e65ea-fe82-4797-b9e8-0b2081710e29 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029649 May 16 18:41:11.857867 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 10/18] 10.222.0.72 () {64 vars in 1335 bytes} [Mon May 16 18:41:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:41:14.148154 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-8b2f4f85-0c01-482c-9bd0-626919fd2032 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:14.149167 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-8b2f4f85-0c01-482c-9bd0-626919fd2032 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 16 18:41:14.149571 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 9/19] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:14.211055 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-bddc7fb8-994e-4de5-a5d8-e44e78d07f60 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:14.235242 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-bddc7fb8-994e-4de5-a5d8-e44e78d07f60 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079266 May 16 18:41:14.236173 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 11/20] 10.222.0.72 () {60 vars in 1291 bytes} [Mon May 16 18:41:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:41:16.545476 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-8b2f4f85-0c01-482c-9bd0-626919fd2032 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:16.546633 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-8b2f4f85-0c01-482c-9bd0-626919fd2032 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 16 18:41:16.547037 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 10/21] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:16.604103 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-5ea7426f-ccf0-43fb-a6e8-17266384178b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "ram": 512, "swap": 0, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:16.622253 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-5ea7426f-ccf0-43fb-a6e8-17266384178b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069543 May 16 18:41:16.622792 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 12/22] 10.222.0.72 () {64 vars in 1282 bytes} [Mon May 16 18:41:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:41:16.634561 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-c8a43ec4-f9af-4df5-827a-fb83a881c258 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:16.658301 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-c8a43ec4-f9af-4df5-827a-fb83a881c258 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027188 May 16 18:41:16.659101 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 11/23] 10.222.0.72 () {64 vars in 1332 bytes} [Mon May 16 18:41:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:41:18.931455 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-5ea7426f-ccf0-43fb-a6e8-17266384178b admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:18.932448 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-5ea7426f-ccf0-43fb-a6e8-17266384178b admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 16 18:41:18.932848 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:18.994741 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-92e00ac2-2117-4397-80e5-b34caaa0e613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:19.015563 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-92e00ac2-2117-4397-80e5-b34caaa0e613 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075829 May 16 18:41:19.016161 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 12/25] 10.222.0.72 () {64 vars in 1282 bytes} [Mon May 16 18:41:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:41:19.027624 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-a267c420-928f-436d-b7cc-5b8650e78a8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:19.051382 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-a267c420-928f-436d-b7cc-5b8650e78a8e admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027359 May 16 18:41:19.051991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 14/26] 10.222.0.72 () {64 vars in 1332 bytes} [Mon May 16 18:41:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:41:21.307678 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-92e00ac2-2117-4397-80e5-b34caaa0e613 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:21.309348 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-92e00ac2-2117-4397-80e5-b34caaa0e613 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 May 16 18:41:21.309966 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 13/27] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:21.381463 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-fecc11d9-849a-4933-87c7-1457d891c1f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:21.399587 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-fecc11d9-849a-4933-87c7-1457d891c1f4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.081524 May 16 18:41:21.400185 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 15/28] 10.222.0.72 () {64 vars in 1282 bytes} [Mon May 16 18:41:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:41:21.411958 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-f82a0ab5-5824-469a-be62-01698c020918 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:21.434770 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-f82a0ab5-5824-469a-be62-01698c020918 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026478 May 16 18:41:21.435401 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 14/29] 10.222.0.72 () {64 vars in 1332 bytes} [Mon May 16 18:41:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:41:23.669532 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-fecc11d9-849a-4933-87c7-1457d891c1f4 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:23.670556 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-fecc11d9-849a-4933-87c7-1457d891c1f4 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 16 18:41:23.671905 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 16/30] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:23.730370 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-a0992837-3914-4d0d-9505-838561ba4bc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "name": "m1.large", "disk": 80, "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:23.752965 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-a0992837-3914-4d0d-9505-838561ba4bc2 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074824 May 16 18:41:23.753624 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 15/31] 10.222.0.72 () {64 vars in 1282 bytes} [Mon May 16 18:41:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 18:41:23.766158 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-4c3196ff-8e84-4cbf-8373-24f95e04ef35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:23.788474 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-4c3196ff-8e84-4cbf-8373-24f95e04ef35 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026284 May 16 18:41:23.789058 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 17/32] 10.222.0.72 () {64 vars in 1332 bytes} [Mon May 16 18:41:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:41:26.096971 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-a0992837-3914-4d0d-9505-838561ba4bc2 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:26.097978 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-a0992837-3914-4d0d-9505-838561ba4bc2 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 16 18:41:26.098386 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 16/33] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:26.158883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-5346f6bf-f855-4769-a7f8-955410c581b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "os-flavor-access:is_public": true}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:26.178979 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-5346f6bf-f855-4769-a7f8-955410c581b5 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074670 May 16 18:41:26.179619 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 18/34] 10.222.0.72 () {64 vars in 1282 bytes} [Mon May 16 18:41:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 18:41:26.191835 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-397c5035-253c-40c1-8927-167e3cd151a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:26.214870 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-397c5035-253c-40c1-8927-167e3cd151a9 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026728 May 16 18:41:26.216506 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 17/35] 10.222.0.72 () {64 vars in 1332 bytes} [Mon May 16 18:41:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:41:51.280968 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-5346f6bf-f855-4769-a7f8-955410c581b5 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:51.281994 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-5346f6bf-f855-4769-a7f8-955410c581b5 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 16 18:41:51.282389 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 19/36] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:41:51.340908 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-b0778741-794e-4834-a814-7eaab599d423 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:51.357788 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-b0778741-794e-4834-a814-7eaab599d423 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069326 May 16 18:41:51.358324 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 18/37] 10.222.0.72 () {60 vars in 1291 bytes} [Mon May 16 18:41:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:41:52.361124 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-5346f6bf-f855-4769-a7f8-955410c581b5 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:52.362146 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-5346f6bf-f855-4769-a7f8-955410c581b5 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 May 16 18:41:52.362540 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 20/38] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:52.567155 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-d72ccadd-f661-4696-b158-6ad070d84877 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:52.572789 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.wsgi [None req-d72ccadd-f661-4696-b158-6ad070d84877 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-d72ccadd-f661-4696-b158-6ad070d84877 admin admin] Request method failure captured: May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Accept: application/json May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Accept-Encoding: gzip, deflate May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Connection: keep-alive May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Content-Length: 0 May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Host: 10.222.0.72 May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Openstack-Api-Version: compute 2.90 May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Openstack-System-Scope: None May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: User-Agent: python-novaclient May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Auth-Token: gAAAAABigprwBdXFbBaTBJqGdCAPZiMLlgUnyDI-4J45YzCGY637aKqY3BTvWVuGamvAyDPUoLnve20pttXs4xZns7kLy7HqrcjwDcJqHdTFVRxAkdcTeTQ8dgOQ6uw8lokuCUp66t42SAiZtgbrsHy7OaWedqaUX6rugSiAzdnJuiIk2fLjtZY May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Domain-Id: None May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Domain-Name: None May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Identity-Status: Confirmed May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Is-Admin-Project: True May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Openstack-Nova-Api-Version: 2.90 May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Domain-Id: default May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Domain-Name: Default May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Name: admin May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Role: reader,admin,member May 16 18:41:52.575988 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Roles: reader,admin,member May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_44adac522ccb43149dbafba14f75fd72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Tenant: admin May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Tenant-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Tenant-Name: admin May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User: admin May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Domain-Id: default May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Domain-Name: Default May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Id: bf98c9865904466fa1a6dd87c28d438c May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Name: admin May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: method: > May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: exception: Flavor 42 could not be found. May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: action_args: {'id': '42'} May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:41:52.577801 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:52.578929 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:52.580248 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-d72ccadd-f661-4696-b158-6ad070d84877 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:41:52.581476 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-d72ccadd-f661-4696-b158-6ad070d84877 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062454 May 16 18:41:52.581476 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 19/39] 10.222.0.72 () {60 vars in 1190 bytes} [Mon May 16 18:41:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 18:41:52.587158 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-ff21a3a6-d355-45e4-8e76-0e879303314b admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:52.608165 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-ff21a3a6-d355-45e4-8e76-0e879303314b admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023942 May 16 18:41:52.608696 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 21/40] 10.222.0.72 () {60 vars in 1210 bytes} [Mon May 16 18:41:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:41:52.621826 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-974c3e9f-0aa6-408a-aeb2-cd7f07e2daa9 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:52.644931 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-974c3e9f-0aa6-408a-aeb2-cd7f07e2daa9 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026676 May 16 18:41:52.645468 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 20/41] 10.222.0.72 () {60 vars in 1210 bytes} [Mon May 16 18:41:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:41:52.654763 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-c41d4194-b544-4d16-ad29-ae36d48ca308 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:52.660311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.wsgi [None req-c41d4194-b544-4d16-ad29-ae36d48ca308 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-c41d4194-b544-4d16-ad29-ae36d48ca308 admin admin] Request method failure captured: May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Accept: application/json May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Accept-Encoding: gzip, deflate May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Connection: keep-alive May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Content-Length: 0 May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Host: 10.222.0.72 May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Openstack-Api-Version: compute 2.90 May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Openstack-System-Scope: None May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: User-Agent: python-novaclient May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Auth-Token: gAAAAABigprwBdXFbBaTBJqGdCAPZiMLlgUnyDI-4J45YzCGY637aKqY3BTvWVuGamvAyDPUoLnve20pttXs4xZns7kLy7HqrcjwDcJqHdTFVRxAkdcTeTQ8dgOQ6uw8lokuCUp66t42SAiZtgbrsHy7OaWedqaUX6rugSiAzdnJuiIk2fLjtZY May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Domain-Id: None May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Domain-Name: None May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Identity-Status: Confirmed May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Is-Admin-Project: True May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Openstack-Nova-Api-Version: 2.90 May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Domain-Id: default May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Domain-Name: Default May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Name: admin May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Role: reader,admin,member May 16 18:41:52.663514 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Roles: reader,admin,member May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_44adac522ccb43149dbafba14f75fd72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Tenant: admin May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Tenant-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Tenant-Name: admin May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User: admin May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Domain-Id: default May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Domain-Name: Default May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Id: bf98c9865904466fa1a6dd87c28d438c May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Name: admin May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: method: > May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: exception: Flavor 42 could not be found. May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: action_args: {'id': '42'} May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:41:52.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:52.665623 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:52.666965 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-c41d4194-b544-4d16-ad29-ae36d48ca308 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:41:52.668207 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-c41d4194-b544-4d16-ad29-ae36d48ca308 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013860 May 16 18:41:52.668207 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 22/42] 10.222.0.72 () {60 vars in 1190 bytes} [Mon May 16 18:41:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 16 18:41:53.587227 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-974c3e9f-0aa6-408a-aeb2-cd7f07e2daa9 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:53.588597 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-974c3e9f-0aa6-408a-aeb2-cd7f07e2daa9 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001795 May 16 18:41:53.589022 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 21/43] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:53.781264 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-d723ea42-f155-42d6-b68d-8664208e9200 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:53.786997 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.wsgi [None req-d723ea42-f155-42d6-b68d-8664208e9200 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-d723ea42-f155-42d6-b68d-8664208e9200 admin admin] Request method failure captured: May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Accept: application/json May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Accept-Encoding: gzip, deflate May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Connection: keep-alive May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Content-Length: 0 May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Host: 10.222.0.72 May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Openstack-Api-Version: compute 2.90 May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Openstack-System-Scope: None May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: User-Agent: python-novaclient May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Auth-Token: gAAAAABigprxW64Yloag_D4_sCyZv-ZFgdAQVaTpyqT1Un8_HBm12KeVcEL17mwMu9oACsNe6_zh6jwpfvbRcgXVeGqOVlIVSypUgxePxfrDKqBgKqk_cRW_iNTpFm3yn73l2QnwPpt554AcNfM5H11hAwefrPXQYnFqXlbqWrx2r_xPITh-Pq8 May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Domain-Id: None May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Domain-Name: None May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Identity-Status: Confirmed May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Is-Admin-Project: True May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Openstack-Nova-Api-Version: 2.90 May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Domain-Id: default May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Domain-Name: Default May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Name: admin May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Role: reader,admin,member May 16 18:41:53.788511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Roles: reader,admin,member May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_44adac522ccb43149dbafba14f75fd72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Tenant: admin May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Tenant-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Tenant-Name: admin May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User: admin May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Domain-Id: default May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Domain-Name: Default May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Id: bf98c9865904466fa1a6dd87c28d438c May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Name: admin May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: method: > May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: exception: Flavor 84 could not be found. May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: action_args: {'id': '84'} May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:41:53.790044 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:53.790883 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:53.791991 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-d723ea42-f155-42d6-b68d-8664208e9200 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:41:53.793246 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-d723ea42-f155-42d6-b68d-8664208e9200 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060232 May 16 18:41:53.793246 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 23/44] 10.222.0.72 () {60 vars in 1190 bytes} [Mon May 16 18:41:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 18:41:53.800001 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-d75825e7-7235-4054-b830-0d8a40eaf942 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:53.813811 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-d75825e7-7235-4054-b830-0d8a40eaf942 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017441 May 16 18:41:53.814338 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1210 bytes} [Mon May 16 18:41:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:41:53.823898 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-565dd12c-3650-4b43-a3c4-3a673c365cd6 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:53.838692 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-565dd12c-3650-4b43-a3c4-3a673c365cd6 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018226 May 16 18:41:53.839252 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1210 bytes} [Mon May 16 18:41:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:41:53.849068 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-8bf30ddd-62f8-450b-8667-221cec803f95 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:53.854214 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.wsgi [None req-8bf30ddd-62f8-450b-8667-221cec803f95 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-8bf30ddd-62f8-450b-8667-221cec803f95 admin admin] Request method failure captured: May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Accept: application/json May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Accept-Encoding: gzip, deflate May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Connection: keep-alive May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Content-Length: 0 May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Host: 10.222.0.72 May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Openstack-Api-Version: compute 2.90 May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Openstack-System-Scope: None May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: User-Agent: python-novaclient May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Auth-Token: gAAAAABigprxW64Yloag_D4_sCyZv-ZFgdAQVaTpyqT1Un8_HBm12KeVcEL17mwMu9oACsNe6_zh6jwpfvbRcgXVeGqOVlIVSypUgxePxfrDKqBgKqk_cRW_iNTpFm3yn73l2QnwPpt554AcNfM5H11hAwefrPXQYnFqXlbqWrx2r_xPITh-Pq8 May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Domain-Id: None May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Domain-Name: None May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Identity-Status: Confirmed May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Is-Admin-Project: True May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Openstack-Nova-Api-Version: 2.90 May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Domain-Id: default May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Domain-Name: Default May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Name: admin May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Role: reader,admin,member May 16 18:41:53.855691 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Roles: reader,admin,member May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_44adac522ccb43149dbafba14f75fd72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Tenant: admin May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Tenant-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Tenant-Name: admin May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User: admin May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Domain-Id: default May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Domain-Name: Default May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Id: bf98c9865904466fa1a6dd87c28d438c May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Name: admin May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: method: > May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: exception: Flavor 84 could not be found. May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: action_args: {'id': '84'} May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:41:53.857237 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:53.859112 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:53.860493 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-8bf30ddd-62f8-450b-8667-221cec803f95 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:41:53.861793 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-8bf30ddd-62f8-450b-8667-221cec803f95 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011566 May 16 18:41:53.861998 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 23/47] 10.222.0.72 () {60 vars in 1190 bytes} [Mon May 16 18:41:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 18:41:54.741203 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-565dd12c-3650-4b43-a3c4-3a673c365cd6 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:54.742205 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-565dd12c-3650-4b43-a3c4-3a673c365cd6 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 16 18:41:54.742599 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 25/48] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:54.934119 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-88fa7870-3a6a-4e30-ad77-e79a8fe44350 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:54.939945 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.wsgi [None req-88fa7870-3a6a-4e30-ad77-e79a8fe44350 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-88fa7870-3a6a-4e30-ad77-e79a8fe44350 admin admin] Request method failure captured: May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Accept: application/json May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Accept-Encoding: gzip, deflate May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Connection: keep-alive May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Content-Length: 0 May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Host: 10.222.0.72 May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Openstack-Api-Version: compute 2.90 May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Openstack-System-Scope: None May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: User-Agent: python-novaclient May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Auth-Token: gAAAAABigprycZx7Ye9eZWzorktNwZ85yXUxWX3MwTvJnhj5cPMuQXzSWtYPFy9O4oghwDm8pA0HldIJrmxk3sO3Tdhdx5nkm9EsBDOHkEKz6tfohRVP4iDAuWqrDva9zFqrBW9Nb0fUxBS6z4Vs0s3OOqgw2DDVb2pfIr81J2iE5hs1vxBQhks May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Domain-Id: None May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Domain-Name: None May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Identity-Status: Confirmed May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Is-Admin-Project: True May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Openstack-Nova-Api-Version: 2.90 May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Domain-Id: default May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Domain-Name: Default May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Project-Name: admin May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Role: reader,admin,member May 16 18:41:54.941460 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Roles: reader,admin,member May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_44adac522ccb43149dbafba14f75fd72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Tenant: admin May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Tenant-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-Tenant-Name: admin May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User: admin May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Domain-Id: default May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Domain-Name: Default May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Id: bf98c9865904466fa1a6dd87c28d438c May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: X-User-Name: admin May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: method: > May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: exception: Flavor 451 could not be found. May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: action_args: {'id': '451'} May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:41:54.943015 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:54.944023 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: ERROR nova.api.openstack.wsgi May 16 18:41:54.945373 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-88fa7870-3a6a-4e30-ad77-e79a8fe44350 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:41:54.946618 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-88fa7870-3a6a-4e30-ad77-e79a8fe44350 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061601 May 16 18:41:54.946618 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 24/49] 10.222.0.72 () {60 vars in 1193 bytes} [Mon May 16 18:41:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 18:41:54.953683 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-caff8fa5-4bc1-4e5a-9809-83287d3fe0bd admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:54.967777 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-caff8fa5-4bc1-4e5a-9809-83287d3fe0bd admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018073 May 16 18:41:54.968301 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 26/50] 10.222.0.72 () {60 vars in 1210 bytes} [Mon May 16 18:41:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:41:54.977509 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:54.990998 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017007 May 16 18:41:54.991575 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 25/51] 10.222.0.72 () {60 vars in 1210 bytes} [Mon May 16 18:41:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:41:55.001185 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-4844af96-c02e-49d2-8b77-98d191630de2 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:55.006285 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.wsgi [None req-4844af96-c02e-49d2-8b77-98d191630de2 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-4844af96-c02e-49d2-8b77-98d191630de2 admin admin] Request method failure captured: May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Accept: application/json May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Accept-Encoding: gzip, deflate May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Connection: keep-alive May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Content-Length: 0 May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Host: 10.222.0.72 May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Openstack-Api-Version: compute 2.90 May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Openstack-System-Scope: None May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: User-Agent: python-novaclient May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Auth-Token: gAAAAABigprycZx7Ye9eZWzorktNwZ85yXUxWX3MwTvJnhj5cPMuQXzSWtYPFy9O4oghwDm8pA0HldIJrmxk3sO3Tdhdx5nkm9EsBDOHkEKz6tfohRVP4iDAuWqrDva9zFqrBW9Nb0fUxBS6z4Vs0s3OOqgw2DDVb2pfIr81J2iE5hs1vxBQhks May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Domain-Id: None May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Domain-Name: None May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Identity-Status: Confirmed May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Is-Admin-Project: True May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Openstack-Nova-Api-Version: 2.90 May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Domain-Id: default May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Domain-Name: Default May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Project-Name: admin May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Role: reader,admin,member May 16 18:41:55.007799 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Roles: reader,admin,member May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_44adac522ccb43149dbafba14f75fd72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/44adac522ccb43149dbafba14f75fd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Tenant: admin May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Tenant-Id: 44adac522ccb43149dbafba14f75fd72 May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-Tenant-Name: admin May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User: admin May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Domain-Id: default May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Domain-Name: Default May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Id: bf98c9865904466fa1a6dd87c28d438c May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: X-User-Name: admin May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: method: > May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: exception: Flavor 451 could not be found. May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: action_args: {'id': '451'} May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:41:55.009394 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:55.010249 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: ERROR nova.api.openstack.wsgi May 16 18:41:55.011311 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-4844af96-c02e-49d2-8b77-98d191630de2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:41:55.012374 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-4844af96-c02e-49d2-8b77-98d191630de2 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012104 May 16 18:41:55.012374 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 27/52] 10.222.0.72 () {60 vars in 1193 bytes} [Mon May 16 18:41:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 16 18:41:55.912458 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:55.913469 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 16 18:41:55.913880 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 26/53] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:41:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:56.104132 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-5e2dd048-1a45-4166-8928-b588bb1e6a8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:56.122656 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-5e2dd048-1a45-4166-8928-b588bb1e6a8f admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068953 May 16 18:41:56.123220 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 28/54] 10.222.0.72 () {64 vars in 1235 bytes} [Mon May 16 18:41:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:41:57.016630 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:57.017642 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 16 18:41:57.018075 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:57.206839 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-5cd1e5c5-c3c2-4a2d-b6de-878a9196a0f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:57.223859 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-5cd1e5c5-c3c2-4a2d-b6de-878a9196a0f2 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068419 May 16 18:41:57.224403 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 29/56] 10.222.0.72 () {64 vars in 1235 bytes} [Mon May 16 18:41:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:41:58.128601 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:58.129622 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 16 18:41:58.130042 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 28/57] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:58.316105 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-c158cceb-008e-41c4-9ef6-a6e458fce1c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:58.333511 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-c158cceb-008e-41c4-9ef6-a6e458fce1c9 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068101 May 16 18:41:58.334054 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 30/58] 10.222.0.72 () {64 vars in 1235 bytes} [Mon May 16 18:41:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 18:41:59.227915 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:41:59.228918 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 16 18:41:59.229319 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 29/59] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:41:59.418083 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-cba28b40-fb95-4beb-9d95-bcbcf6c012b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:41:59.434959 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-cba28b40-fb95-4beb-9d95-bcbcf6c012b1 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068206 May 16 18:41:59.435506 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 31/60] 10.222.0.72 () {64 vars in 1235 bytes} [Mon May 16 18:41:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:42:00.344795 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:42:00.345784 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 16 18:42:00.346188 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 30/61] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:42:00.533601 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-0b6a9b69-5ff6-4067-b208-4503014bbbbf admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:42:00.552371 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-0b6a9b69-5ff6-4067-b208-4503014bbbbf admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070436 May 16 18:42:00.552954 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 32/62] 10.222.0.72 () {60 vars in 1202 bytes} [Mon May 16 18:42:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:43:03.223643 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:43:03.224699 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-0c8050b3-fd09-4d5e-a37f-09dca2bff6be admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 16 18:43:03.225101 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 31/63] 10.222.0.72 () {54 vars in 930 bytes} [Mon May 16 18:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:43:03.281717 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-6d2b902b-df5b-4f54-a4f0-fd3a3e8fc039 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:43:03.300287 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-6d2b902b-df5b-4f54-a4f0-fd3a3e8fc039 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069536 May 16 18:43:03.300820 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 33/64] 10.222.0.72 () {60 vars in 1291 bytes} [Mon May 16 18:43:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:43:03.323078 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-3e5602ca-e845-47d2-887d-b82803e62738 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:43:03.331183 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-3e5602ca-e845-47d2-887d-b82803e62738 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012256 May 16 18:43:03.331701 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 32/65] 10.222.0.72 () {60 vars in 1282 bytes} [Mon May 16 18:43:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:43:03.343383 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-124066ea-f905-4493-9981-dfd3815adcc2 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:43:03.350935 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-124066ea-f905-4493-9981-dfd3815adcc2 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011454 May 16 18:43:03.351460 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 34/66] 10.222.0.72 () {60 vars in 1285 bytes} [Mon May 16 18:43:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:43:03.362800 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-18b0807c-193a-4044-a2d7-fa52c8722da3 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:43:03.370074 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-18b0807c-193a-4044-a2d7-fa52c8722da3 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010801 May 16 18:43:03.370590 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 33/67] 10.222.0.72 () {60 vars in 1285 bytes} [Mon May 16 18:43:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:43:03.381476 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-e711fced-43c9-41a3-9367-820eaef6e8d8 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:43:03.389582 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-e711fced-43c9-41a3-9367-820eaef6e8d8 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011658 May 16 18:43:03.390098 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 35/68] 10.222.0.72 () {60 vars in 1282 bytes} [Mon May 16 18:43:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:46:28.132864 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-18b0807c-193a-4044-a2d7-fa52c8722da3 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:46:28.133917 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-18b0807c-193a-4044-a2d7-fa52c8722da3 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 May 16 18:46:28.134353 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 34/69] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:46:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:46:28.480124 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-aac1b675-1c08-48d0-a882-e355ee38c51a admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:46:28.480124 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:46:28.480124 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: warnings.warn(msg) May 16 18:46:28.483371 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-aac1b675-1c08-48d0-a882-e355ee38c51a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:46:28.483371 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-aac1b675-1c08-48d0-a882-e355ee38c51a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:46:28.483371 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-aac1b675-1c08-48d0-a882-e355ee38c51a admin admin] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:46:28.484257 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-aac1b675-1c08-48d0-a882-e355ee38c51a admin admin] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:46:28.530442 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-aac1b675-1c08-48d0-a882-e355ee38c51a admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.230493 May 16 18:46:28.531034 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 36/70] 10.222.0.72 () {60 vars in 1193 bytes} [Mon May 16 18:46:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:46:29.496181 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-18b0807c-193a-4044-a2d7-fa52c8722da3 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:46:29.497188 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-18b0807c-193a-4044-a2d7-fa52c8722da3 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 16 18:46:29.497624 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 35/71] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:46:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:46:29.709938 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-fe09bca0-d7e7-4564-b7c7-67daf1def195 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:46:29.711142 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:46:29.711142 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: warnings.warn(msg) May 16 18:46:29.712372 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-fe09bca0-d7e7-4564-b7c7-67daf1def195 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:46:29.712797 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-fe09bca0-d7e7-4564-b7c7-67daf1def195 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:46:29.713614 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-fe09bca0-d7e7-4564-b7c7-67daf1def195 admin admin] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:46:29.714030 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-fe09bca0-d7e7-4564-b7c7-67daf1def195 admin admin] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:46:29.734012 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-fe09bca0-d7e7-4564-b7c7-67daf1def195 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.082420 May 16 18:46:29.734591 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 37/72] 10.222.0.72 () {60 vars in 1193 bytes} [Mon May 16 18:46:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:46:41.068477 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-18b0807c-193a-4044-a2d7-fa52c8722da3 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:46:41.069490 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-18b0807c-193a-4044-a2d7-fa52c8722da3 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 16 18:46:41.070062 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 36/73] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:46:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:46:41.264495 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-8375071f-2454-4d9b-be66-05274df96c44 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:46:41.265740 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:46:41.265740 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: warnings.warn(msg) May 16 18:46:41.267017 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-8375071f-2454-4d9b-be66-05274df96c44 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:46:41.267471 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-8375071f-2454-4d9b-be66-05274df96c44 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:46:41.268309 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-8375071f-2454-4d9b-be66-05274df96c44 admin admin] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:46:41.268727 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-8375071f-2454-4d9b-be66-05274df96c44 admin admin] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:46:41.293706 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-8375071f-2454-4d9b-be66-05274df96c44 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.082497 May 16 18:46:41.294268 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 38/74] 10.222.0.72 () {60 vars in 1193 bytes} [Mon May 16 18:46:41 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:46:42.194129 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: DEBUG nova.api.openstack.wsgi [None req-18b0807c-193a-4044-a2d7-fa52c8722da3 admin admin] Calling method '>' {{(pid=114539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:46:42.195132 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: INFO nova.api.openstack.requestlog [None req-18b0807c-193a-4044-a2d7-fa52c8722da3 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 16 18:46:42.196113 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: [pid: 114539|app: 0|req: 37/75] 10.222.0.72 () {56 vars in 1074 bytes} [Mon May 16 18:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:46:42.385204 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG nova.api.openstack.wsgi [None req-5dcf4ce4-1327-4488-900d-6eb6adad0fd0 admin admin] Calling method '>' {{(pid=114538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:46:42.386362 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:46:42.386362 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: warnings.warn(msg) May 16 18:46:42.387516 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-5dcf4ce4-1327-4488-900d-6eb6adad0fd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:46:42.387977 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-5dcf4ce4-1327-4488-900d-6eb6adad0fd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:46:42.388748 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-5dcf4ce4-1327-4488-900d-6eb6adad0fd0 admin admin] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:46:42.389164 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: DEBUG oslo_concurrency.lockutils [None req-5dcf4ce4-1327-4488-900d-6eb6adad0fd0 admin admin] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:46:42.409888 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: INFO nova.api.openstack.requestlog [None req-5dcf4ce4-1327-4488-900d-6eb6adad0fd0 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.075676 May 16 18:46:42.410438 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: [pid: 114538|app: 0|req: 39/76] 10.222.0.72 () {60 vars in 1193 bytes} [Mon May 16 18:46:42 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:47:39.726429 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: Mon May 16 18:47:39 2022 - graceful shutdown triggered... May 16 18:47:39.727004 dv-cinder-750782-22-iscsi devstack@n-api.service[114538]: Gracefully killing worker 1 (pid: 114538)... May 16 18:47:39.728395 dv-cinder-750782-22-iscsi devstack@n-api.service[114539]: Gracefully killing worker 2 (pid: 114539)... May 16 18:47:39.729149 dv-cinder-750782-22-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 16 18:47:40.727565 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: worker 1 buried after 1 seconds May 16 18:47:40.727565 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: worker 2 buried after 1 seconds May 16 18:47:40.727565 dv-cinder-750782-22-iscsi devstack@n-api.service[114537]: goodbye to uWSGI. May 16 18:47:40.729192 dv-cinder-750782-22-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 16 18:47:40.729773 dv-cinder-750782-22-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 16 18:47:40.732549 dv-cinder-750782-22-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 18:47:40.747207 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 18:47:40 2022] *** May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: nodename: dv-cinder-750782-22-iscsi May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: machine: x86_64 May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: clock source: unix May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: pcre jit disabled May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: detected number of CPU cores: 4 May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: current working directory: / May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: detected binary path: /usr/bin/uwsgi-core May 16 18:47:40.762534 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: your processes number limit is 47680 May 16 18:47:40.763350 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: your memory page size is 4096 bytes May 16 18:47:40.763350 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: detected max file descriptor number: 2048 May 16 18:47:40.763350 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: lock engine: pthread robust mutexes May 16 18:47:40.763350 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: thunder lock: enabled May 16 18:47:40.763350 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 18:47:40.763350 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 18:47:40.809800 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: Python main interpreter initialized at 0x5630ef25f9c0 May 16 18:47:40.809800 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: python threads support enabled May 16 18:47:40.809800 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: your server socket listen backlog is limited to 100 connections May 16 18:47:40.809800 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: your mercy for graceful operations on workers is 90 seconds May 16 18:47:40.810249 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: mapped 403077 bytes (393 KB) for 2 cores May 16 18:47:40.810249 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: *** Operational MODE: preforking *** May 16 18:47:40.810545 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: *** uWSGI is running in multiple interpreter mode *** May 16 18:47:40.810545 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: spawned uWSGI master process (pid: 128872) May 16 18:47:40.810753 dv-cinder-750782-22-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 18:47:40.812411 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: spawned uWSGI worker 1 (pid: 128886, cores: 1) May 16 18:47:40.812411 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: spawned uWSGI worker 2 (pid: 128887, cores: 1) May 16 18:47:40.812411 dv-cinder-750782-22-iscsi devstack@n-api.service[128872]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 18:47:42.029400 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 18:47:42.035087 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 18:47:42.828439 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:47:42.828439 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: from cryptography.utils import int_from_bytes May 16 18:47:42.828767 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:47:42.828767 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: from cryptography.utils import int_from_bytes May 16 18:47:42.847102 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:47:42.847102 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: from cryptography.utils import int_from_bytes May 16 18:47:42.847410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:47:42.847410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: from cryptography.utils import int_from_bytes May 16 18:47:45.305279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 18:47:45.305827 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 18:47:45.306143 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 18:47:45.306509 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 18:47:45.306773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 18:47:45.307171 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.307496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.307846 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.308172 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.308503 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.308820 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.309148 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.309474 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.309803 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.310078 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.310384 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.310712 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-750782-22-iscsi {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.311037 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.311349 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.311667 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.312014 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.312322 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.312647 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.312955 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.313458 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.314961 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.314961 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.314961 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.314961 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.315297 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.315506 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.315770 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.316094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.316415 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.316731 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.317124 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-750782-22-iscsi {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.317426 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.317741 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.318071 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.318469 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.318781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.319087 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.319409 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.319755 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.320065 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.320432 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.321324 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.321698 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.321947 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.322229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.322548 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.322855 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.323174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.323483 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.323815 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.324069 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.324380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.324703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.325026 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.325349 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.325601 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.325854 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.326172 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.326492 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.326804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.327113 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.327420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.327740 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.328070 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.328366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.328673 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.328978 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.329297 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.329617 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.329935 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.330244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.330563 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.330964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.331218 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.331532 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.331970 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.332291 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.332660 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.332964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.333669 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.333907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.334175 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.334464 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.334783 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.335106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.335416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.335668 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.336015 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.336640 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.336640 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.337056 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.337370 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.337680 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.337985 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.338293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.338601 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.338907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.339214 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.339798 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.340109 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.340417 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.340723 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.341026 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.341344 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.341671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.341980 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.343201 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.343201 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.343201 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.343201 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.343534 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.343796 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.344121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.344428 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.344735 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.345054 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.345363 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.345669 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.345988 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.346290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.346598 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.346917 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.347225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.347531 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.347860 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.348168 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.348472 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.348778 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.349083 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.349388 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.349688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.350007 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.350328 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.350640 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.350950 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.351261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.351588 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.352306 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.352306 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.352650 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.352963 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.353297 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.353460 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 18:47:45.353971 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.354144 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 18:47:45.354297 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.354472 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 18:47:45.354622 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.354622 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.354917 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 18:47:45.354917 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 18:47:45.355217 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.355217 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.355523 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.355684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.355861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.356009 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.356155 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.356302 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.356459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.356626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.356785 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.356940 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.357088 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.357241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.357403 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.357568 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.357715 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.357952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.358106 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.358265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.358435 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.358592 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.358748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.358896 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.359050 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-750782-22-iscsi {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.359212 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.359381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.359531 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.359677 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.359881 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.360039 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.360203 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.360352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.360516 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.360672 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.360819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.360966 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.361126 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.361281 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.361436 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.361584 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.361759 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.361914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.362071 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.362239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.362393 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.362542 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.362689 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.362849 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.362998 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.363152 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.363313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.363469 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.363625 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.363625 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.364069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.364226 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.364393 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.364552 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.364702 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.364929 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.365090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.365245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.365401 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-750782-22-iscsi {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.365564 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.365726 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.365881 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.366036 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.366191 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.366338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.366514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.366672 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.366821 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.366975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.367130 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.367858 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.368186 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.368345 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.368623 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.368623 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.368928 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.369079 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.369252 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.369252 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.369531 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.369678 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.369832 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.369981 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.370137 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.370292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.370440 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.370601 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.370769 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.370769 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.370769 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.371221 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.371221 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.371506 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.371824 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.372141 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.372459 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.372769 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.373099 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.373415 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.373727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.373993 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.374246 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.374492 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.374751 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.374997 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.375240 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.375240 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.375634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.375806 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.375956 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.376114 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.376114 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.376413 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.376570 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.376719 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.376886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.377034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.377195 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.377353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.377516 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.377672 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.377837 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.377991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.378174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.378421 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.378581 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.378739 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.378906 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.379068 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.379225 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.379383 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.379531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.379685 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.379900 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.380060 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.380215 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.380371 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.380371 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.380649 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.380803 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.380975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.381130 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.381286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.381435 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.381589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.381751 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.381907 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.382061 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.382209 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.382361 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.382520 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.382678 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.382846 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.383611 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.384336 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.384519 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.384679 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.384836 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.384999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.385148 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.385295 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.385442 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.385590 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.385745 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.385908 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.386076 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.386232 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.386379 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.386535 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.386684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.386841 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.386997 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.387145 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.387292 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.387446 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.387601 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.387828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.387992 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.388168 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.388317 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.388561 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.388725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.388884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.389040 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.389198 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.389357 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.389514 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.389673 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.389829 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.389984 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.390140 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.390299 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.390453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.390611 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.390767 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.390916 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.391071 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.391220 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.392005 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.392162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.392311 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.392473 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.392633 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.392787 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.392944 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.393334 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.393492 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.393656 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.393805 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.393951 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.394106 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.394261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.394261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.394261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.394261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.394261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.394261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.394261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.395244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.395244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.395244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.395244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.395972 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.395972 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.396266 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.396507 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.396807 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.397139 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.397475 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.397788 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.398102 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.398429 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.399387 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.400012 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.400012 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.400311 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.400476 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.400626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.400772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.400918 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.401085 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.401233 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.401391 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.401546 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.401709 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.401866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.402022 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.402186 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.402343 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.402501 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.402650 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.402803 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.402958 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.403131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.403280 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.403570 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.403770 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.403970 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.404125 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.404297 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.404448 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.404623 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.404787 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.404942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.405090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.405245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.405404 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.405560 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.405722 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.405878 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.406035 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.406188 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.406587 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.406766 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.406928 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.407085 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.407241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.407516 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.407921 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.408121 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.408273 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.408420 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.408585 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.408741 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.408933 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.409129 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.409392 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.409546 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.409702 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.409851 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.410012 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.410181 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.410337 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.410485 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.410639 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.410787 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.410933 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.411093 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.411249 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.411403 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.411557 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.411722 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.411891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.412039 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.412269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.412431 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.412686 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.413144 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.413606 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.413886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.414042 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.414803 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.415569 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.415766 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.415942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.416094 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.416241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.416399 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.416399 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:47:45.416678 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.416678 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.416975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.417124 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.417270 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.417417 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.417798 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.418281 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.418502 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.418657 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.418851 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.419013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.419211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.419387 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.419614 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.419821 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.419984 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.420133 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.420280 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.420434 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.420588 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.420749 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.420898 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.421065 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.421219 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.421638 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.422104 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.422338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.422500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.422686 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.422848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.423026 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.423181 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.423368 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.423531 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.423688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.423872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.424031 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.424194 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.424349 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.424513 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.424661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.424808 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.424954 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.425343 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.425810 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.426171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.426325 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.426521 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.426692 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.426849 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.426996 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.427177 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.427339 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.427495 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.427643 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.427829 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.427980 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.428159 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.428315 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.428504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.428678 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.428882 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.429032 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.429187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.429380 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.429537 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.429813 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.430477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.430642 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.430792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.430792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.431081 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.431309 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.431470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.431619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.432003 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.432158 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.432316 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.432474 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.432629 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.432777 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.432923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.433077 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.433238 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.433386 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.433546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.433813 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.433971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.434126 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.434284 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.434432 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.434579 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.434725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.434880 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.435036 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.435198 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.435357 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.435512 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.435671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.435879 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.436028 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.436028 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.436332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.436486 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.436640 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.436794 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.436956 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.436956 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.437235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.437389 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.437537 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.437696 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.437862 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.438019 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.438168 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.438313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.438468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.438615 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.438771 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.438771 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.439048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.439196 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.439409 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.439564 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.439768 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.440001 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.440155 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.440303 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.440461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.440616 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.440790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.440946 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.441108 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.441263 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.441416 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.441583 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.441738 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.441910 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.442072 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.442235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.442397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.442568 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.442722 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.442875 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.443027 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.443190 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.443355 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.443520 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.443675 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.443918 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.444085 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.444238 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.444400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.444565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.444719 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.444871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.445032 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.445194 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.445386 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.446076 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.446257 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.446424 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.446424 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.446730 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.446923 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.447088 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.447250 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.447413 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.447569 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.447746 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.447924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.448080 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.448234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.448387 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.448548 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.448723 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.448887 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.449042 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.449210 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.449366 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.449518 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.449681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.449842 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.450023 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.450265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.450425 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.450587 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.450755 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.450927 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.451089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.451291 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.451456 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.451611 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.451806 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.451969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.452131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.452285 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.452447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.452602 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.452764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.452919 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.453083 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.453237 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.453397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.453578 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.453742 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.453905 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.454059 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.454219 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.454373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.454540 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.454704 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.454859 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.455012 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.455174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.455334 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.455501 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.455664 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.455855 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.456017 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.456178 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.456339 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.456506 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.456683 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.456852 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.457016 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.457181 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.457383 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.457547 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.457702 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.457863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.458019 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.458173 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.458335 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.458490 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.458644 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.458798 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.458959 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.459128 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.459307 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.459470 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.459470 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.459814 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.459975 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.460149 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.460407 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.460570 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.460724 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.460885 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.461550 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.461931 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.462435 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.462605 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.462767 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.462923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.463084 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.463254 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.463410 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.463572 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.463862 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.464025 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.464025 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.464331 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.464331 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.464883 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.465048 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.465202 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.465370 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.465525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.465525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.465821 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.465982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.466144 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.466379 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.466536 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.466690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.466850 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.467030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.467199 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.467363 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.467519 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.467672 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.467862 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.468026 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.468180 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.468348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.468510 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.468664 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.468817 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.468976 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.469142 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.469311 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.469474 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.469629 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.469782 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.469935 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.470107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.470263 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.470433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.470664 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.470833 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.470995 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.471164 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.471331 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.471492 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.471654 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.471849 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.471960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472078 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472181 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472285 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472457 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472549 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472650 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472739 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472892 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.472970 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.473140 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.473231 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.473312 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.473395 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.473490 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.473578 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.473667 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.473753 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.473839 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.473918 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474002 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474087 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474180 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474260 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474336 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474506 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474585 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474672 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474757 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474836 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.474921 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475007 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475099 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475178 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475258 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475400 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475567 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475661 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475661 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475844 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.475941 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.476035 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.476133 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.476220 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.476302 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.476391 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.476391 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.476559 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.476717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.477324 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.477416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.477497 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.477497 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.477649 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.477787 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.477900 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.478163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.478292 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.478433 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.478631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.478796 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.478956 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.479111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.479266 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.479431 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.479595 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.479836 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.480021 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.480185 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.480348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.480511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.480796 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.480968 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.481126 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.481289 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.481452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.481622 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.481778 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.481939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.482095 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.482259 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.482420 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.482590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.482753 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.482909 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.483070 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.483234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.483396 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.483565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.483752 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.483925 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.484081 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.484243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.484243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.484557 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.484727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.484927 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.485085 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.485240 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.485408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.485564 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.485717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.485870 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.486023 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.486183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.486357 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.486521 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.486684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.486847 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.487010 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.487172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.487339 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.487506 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.487671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.487884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.488049 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.488212 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.488400 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.488573 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.488736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.488901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.489056 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.489210 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.489372 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.489537 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.489701 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.489866 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.490028 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.490183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.490344 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.490500 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.490675 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.490924 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.491085 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.491240 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.491393 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.491548 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.491736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.491899 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.492052 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.492206 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.492818 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.492993 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.493168 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.493337 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.493502 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.493659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.493821 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.493976 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.494139 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.494139 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.494443 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.494597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.494758 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.494922 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.495090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.495246 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.495417 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.495574 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.495747 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.495925 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.496090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.496246 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.496401 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.496553 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.496714 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.496879 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.497034 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.497188 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.497360 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.497516 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.497670 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.497838 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.497994 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.498147 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.498301 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.498463 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.498626 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.498791 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.498948 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.499109 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.499264 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.499435 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.499673 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.499858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.500015 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.500015 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.500320 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.500475 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.500643 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.500799 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.501052 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.501223 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.501378 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.501540 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.501715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.501878 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.502041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.502197 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.502350 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.502512 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.502677 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.502840 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.502995 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.503157 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.503319 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.503483 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.503655 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.503845 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.504002 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.504156 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.504309 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.504474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.504638 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.504802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.504957 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.505111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.505265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.505429 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.505583 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.505755 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.505911 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.506075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.506240 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.506403 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.506565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.506742 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.506921 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.507085 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.507250 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.507406 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.507560 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.507776 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.508449 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.508626 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.508782 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.508937 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.509100 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.509258 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.509426 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.509582 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.509744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.509908 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.510071 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.510238 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.510408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.510566 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.510720 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.510874 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.511047 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.511047 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.511458 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.511458 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.511781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.511953 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.512115 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.512281 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.512454 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.512611 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.512773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.512936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.513098 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.513263 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.513426 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.513582 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.513744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.513900 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.514062 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.514217 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.514381 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.514535 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.514697 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.514854 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.514854 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.515164 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.515321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.515474 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.515636 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.515845 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.516018 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.516174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.516174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.516476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.516631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.516786 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.516954 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.517110 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.517271 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.517427 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.517588 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.517763 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.517979 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.518142 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.518298 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.518459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.518643 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.518809 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.518964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.519127 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.519289 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.519451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.519451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.519775 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.519938 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.520091 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.520251 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.520414 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.520582 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.520761 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.520926 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.521081 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.521235 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.521497 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.521660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.521826 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.521983 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.522137 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.522297 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.522452 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.522688 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.522863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.523027 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.523182 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.523335 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.524007 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.524626 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.524809 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.524977 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.525141 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.525305 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.525469 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.525639 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.525803 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.525969 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.526133 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.526288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.526441 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.526605 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.526760 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.526914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.527068 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.527230 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.527394 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.527557 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.527848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.528028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.528197 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.528351 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.528519 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.528684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.528839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.528992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.529146 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.529308 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.529511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.529677 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.529833 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.529987 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.530168 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.530335 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.530499 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.530655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.530818 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.530973 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.531134 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.531298 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.531481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.531481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.531906 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.532074 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.532231 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.532231 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.532231 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.532688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.532842 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.532995 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.533157 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.533324 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.533496 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.533652 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.533813 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.533968 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.534121 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.534288 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.534453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.534626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.534872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.535033 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.535205 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.535361 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.535515 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.535670 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.535849 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.535849 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.536163 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.536319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.536473 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.536640 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.536801 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.536965 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.537129 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.537293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.537448 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.537602 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.537757 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.537911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.538074 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.538237 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.538392 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.538562 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.538737 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.538911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.539075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.539906 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.540538 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.540706 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.540863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.541034 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.541191 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.541347 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.541509 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.541690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.541948 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.542119 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.542277 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.542439 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.542595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.542750 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.542920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.542920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.543224 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.543377 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.543531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.543684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.543875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.544044 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.544199 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.544360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.544525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.544691 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.544862 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.545019 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.545181 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.545344 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.545509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.545509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.545813 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.545982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.546137 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.546298 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.546463 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.546628 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.546791 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.546791 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.547095 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.547256 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.547419 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.547588 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.547780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.547942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.548110 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.548265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.548429 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.548594 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.548750 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.548750 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.549061 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.549218 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.549388 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.549553 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.549708 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.549863 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.550026 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.550189 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.550360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.550516 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.550678 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.550844 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.551008 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.551165 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.551332 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.551488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.551650 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.551846 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.552089 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.552270 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.552437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.552602 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.552765 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.552921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.553083 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.553248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.553413 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.553569 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.553730 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.553893 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.554057 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.554057 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.554388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.554546 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.554700 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.555366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.555547 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.555836 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.556010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.556175 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.556330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.556485 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.556651 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.556820 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.557002 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.557157 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.557311 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.557473 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.557640 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.557796 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.557950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.558104 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.558257 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.558412 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.558580 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.558743 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.558898 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.559069 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.559224 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.559379 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.559542 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.559697 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.559886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.560039 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.560039 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.560348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.560503 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.560664 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.560819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.560980 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.561145 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.561308 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.561308 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.561608 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.561771 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.561925 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.562107 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.562351 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.562520 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.562676 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.562832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.562993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.563160 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.563325 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.563488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.563642 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.563834 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.563998 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.564162 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.564325 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.564491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.564646 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.564799 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.564953 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.565115 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.565288 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.565444 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.565597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.565758 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.565913 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.566081 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.566236 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.566390 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.566543 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.566759 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.566928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.567094 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.567249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.567421 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.567584 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.567777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.567958 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.568126 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.568290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.568446 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.568599 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.568753 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.568916 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.569073 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.569228 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.569403 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.569559 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.569712 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.569875 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.570032 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.570186 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.570360 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.570582 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.570743 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.570907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.571183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.571350 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.571514 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.571688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.571912 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.572072 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.572228 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.572472 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.572633 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.572787 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.572787 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.573100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.573255 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.573412 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.573566 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.573727 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.573907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.574063 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.574225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.574384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.574547 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.574712 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.574877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.575032 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.575192 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.575347 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.575502 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.575666 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.575853 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.576008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.576162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.576327 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.576484 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.576651 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.576807 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.576961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.577123 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.577457 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.577457 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 18:47:45.577772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.577772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.577772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.577772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.577772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.577772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.577772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.578801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.578801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.578801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.578801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.578801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.578801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.578801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.578801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.579960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.579960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.579960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.579960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.579960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.579960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.579960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.579960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.580600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.580600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.580600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.580600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.580600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.580600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.580600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.580600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.581192 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.581192 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.581192 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.581432 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.581668 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.581989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.582306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.582640 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.582959 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.583272 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.583600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.583945 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.584494 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.584858 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.585187 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.585525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.585861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.586782 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.586782 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.587503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.587662 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.587977 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.588303 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.588625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.588948 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.589321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.589840 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.590164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.590475 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.590811 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.591120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.591437 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.591776 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.592205 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.592414 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.592720 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.593032 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.593347 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.593661 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.593981 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.594290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.594604 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.594924 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.595236 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.595370 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_db.sqlalchemy.engines [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:47:45.595557 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.595894 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.596213 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.596585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.596922 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.597238 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.597550 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.597879 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.598200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.598532 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.598855 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.599177 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.599535 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.599956 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.600459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.600805 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.601138 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.601488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.602373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.603138 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.603138 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.603320 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.603622 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.603970 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.604294 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.604616 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.604939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.605261 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.605582 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.605905 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.606229 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.606550 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.606869 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.607189 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.607509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.607859 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.608212 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.608543 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.608869 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.609195 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.609523 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.609846 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.610169 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.610489 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.610808 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.611133 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.611474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.611822 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.612142 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.612578 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.612898 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.613227 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.613557 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.613881 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.614214 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.614547 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.614868 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.615200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.615520 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.615878 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.616242 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.616581 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.616916 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.617252 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.617570 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.618026 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.618352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.618684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.619004 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.619319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.619632 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.619979 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.620293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.620608 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.620921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.621233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.621552 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.621864 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.622176 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.622489 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.622801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.623111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.623423 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.623853 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.624081 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.624395 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.624706 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.625018 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.625330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.625671 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.626012 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.626346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.626681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.627001 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.627332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.627655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.628011 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.628342 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.628665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.628985 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.629342 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.629644 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.629964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.630288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.630604 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.630926 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.631244 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.631578 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.631938 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.632254 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.632587 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.633052 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.633635 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.633774 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.634096 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.634435 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.634756 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.635075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.635399 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.635733 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.636063 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.636395 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.636721 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.637057 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.637394 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.637714 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.638047 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.638382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.638737 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.639061 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.639415 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.639771 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.640099 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.640426 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.640740 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:47:45.640991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 18:47:45.660333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.context [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),84d05d0b-ae3d-4239-a9ae-52dba225be17(cell1) {{(pid=128887) load_cells /opt/stack/nova/nova/context.py:464}} May 16 18:47:45.665310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:47:45.665653 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_db.sqlalchemy.engines [None req-fcaf464c-5207-4855-a516-42b0518141db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:47:45.666903 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:47:45.667743 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:47:45.669698 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:47:45.681771 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_db.sqlalchemy.engines [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:47:45.682920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_db.sqlalchemy.engines [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:47:45.733369 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.context [None req-fcaf464c-5207-4855-a516-42b0518141db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),84d05d0b-ae3d-4239-a9ae-52dba225be17(cell1) {{(pid=128886) load_cells /opt/stack/nova/nova/context.py:464}} May 16 18:47:45.737896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fcaf464c-5207-4855-a516-42b0518141db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:47:45.739495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fcaf464c-5207-4855-a516-42b0518141db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:47:45.740337 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fcaf464c-5207-4855-a516-42b0518141db None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:47:45.742325 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fcaf464c-5207-4855-a516-42b0518141db None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:47:45.753929 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_db.sqlalchemy.engines [None req-fcaf464c-5207-4855-a516-42b0518141db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:47:45.755286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_db.sqlalchemy.engines [None req-fcaf464c-5207-4855-a516-42b0518141db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:47:45.849783 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_db.sqlalchemy.engines [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:47:45.929404 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_db.sqlalchemy.engines [None req-fcaf464c-5207-4855-a516-42b0518141db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:47:46.186601 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: WARNING keystonemiddleware.auth_token [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:47:46.194134 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: WARNING keystonemiddleware.auth_token [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:47:46.267229 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: WARNING keystonemiddleware.auth_token [None req-fcaf464c-5207-4855-a516-42b0518141db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:47:46.275442 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: WARNING keystonemiddleware.auth_token [None req-fcaf464c-5207-4855-a516-42b0518141db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:47:46.539011 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: WARNING keystonemiddleware.auth_token [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:47:46.545552 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: WARNING keystonemiddleware.auth_token [None req-ab68b712-4d88-4fbb-81db-061f1ad6e91b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:47:46.550688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5630ef25f9c0 pid: 128887 (default app) May 16 18:47:46.623654 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: WARNING keystonemiddleware.auth_token [None req-fcaf464c-5207-4855-a516-42b0518141db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:47:46.629924 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: WARNING keystonemiddleware.auth_token [None req-fcaf464c-5207-4855-a516-42b0518141db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:47:46.635845 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5630ef25f9c0 pid: 128886 (default app) May 16 18:48:30.837331 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-29e1d40d-97b6-43d7-a521-b06578f844b0 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Action: 'create', calling method: .version_select at 0x7f6469deb280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-489251604"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:32.149651 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-29e1d40d-97b6-43d7-a521-b06578f844b0 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.892904 May 16 18:48:32.157605 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 1/1] 10.222.0.72 () {60 vars in 1154 bytes} [Mon May 16 18:48:29 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2902 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 18:48:32.177290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e6e09fe4-d906-478e-81bd-61ef46db18f4 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469c43280>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:32.296818 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e6e09fe4-d906-478e-81bd-61ef46db18f4 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd" status: 200 len: 344 microversion: 2.1 time: 0.136901 May 16 18:48:32.303181 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 2/2] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:48:32 2022] GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd => generated 344 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:32.706300 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-128493772", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "networks": [{"uuid": "0c75a3ed-7213-40cc-afeb-904a2bdea446"}]}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:33.223695 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.network.neutron [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] validate_networks() for [('0c75a3ed-7213-40cc-afeb-904a2bdea446', None, None, None, None, None)] {{(pid=128886) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:48:33.310919 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7a8c504c-f827-4d4b-9bb0-852a44e9d3ed tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469c43430>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:33.453204 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7a8c504c-f827-4d4b-9bb0-852a44e9d3ed tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd" status: 200 len: 345 microversion: 2.1 time: 0.142203 May 16 18:48:33.453867 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 3/3] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:48:33 2022] GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:48:33.468423 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-cb83b0e4-2ead-4682-a883-920ee94773d4 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Action: 'create', calling method: .version_select at 0x7f6469c43940>, body: {"snapshot": {"volume_id": "994f2054-f65f-4d59-88e0-876d463eacfd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1428217466"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:34.104268 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-cb83b0e4-2ead-4682-a883-920ee94773d4 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.640897 May 16 18:48:34.114250 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 4/4] 10.222.0.72 () {60 vars in 1161 bytes} [Mon May 16 18:48:33 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:34.126508 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e0b373a1-01ce-4b76-9776-f80ecef7a343 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469c425e0>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:34.189476 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e0b373a1-01ce-4b76-9776-f80ecef7a343 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 200 len: 287 microversion: 2.1 time: 0.073720 May 16 18:48:34.190089 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 5/5] 10.222.0.72 () {58 vars in 1250 bytes} [Mon May 16 18:48:34 2022] GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:34.212273 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f450ae9c-7435-4ec9-a569-97453aabf322 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469c43e50>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:34.284483 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f450ae9c-7435-4ec9-a569-97453aabf322 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.085850 May 16 18:48:34.298506 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 6/6] 10.222.0.72 () {58 vars in 1139 bytes} [Mon May 16 18:48:34 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:34.309738 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c318ddd9-66f5-4f11-8666-8f413c00e463 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469c42280>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:34.381654 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c318ddd9-66f5-4f11-8666-8f413c00e463 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 200 len: 287 microversion: 2.1 time: 0.081723 May 16 18:48:34.382943 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 7/7] 10.222.0.72 () {58 vars in 1250 bytes} [Mon May 16 18:48:34 2022] GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:35.394887 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e04d28ac-04e2-4021-bd07-4368447ea6de tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469c421f0>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:35.454771 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e04d28ac-04e2-4021-bd07-4368447ea6de tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 200 len: 287 microversion: 2.1 time: 0.064934 May 16 18:48:35.455638 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 8/8] 10.222.0.72 () {58 vars in 1250 bytes} [Mon May 16 18:48:35 2022] GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:48:36.467824 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7625dfe6-77ce-441e-998a-c80251f63df6 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469c433a0>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:36.565015 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7625dfe6-77ce-441e-998a-c80251f63df6 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 200 len: 287 microversion: 2.1 time: 0.102126 May 16 18:48:36.565831 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 9/9] 10.222.0.72 () {58 vars in 1250 bytes} [Mon May 16 18:48:36 2022] GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:48:36.933861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Flavor limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:48:36.934405 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Image limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:48:36.934779 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Flavor pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:48:36.935552 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Image pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:48:36.936227 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:48:37.000798 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:37.011527 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:37.012538 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:37.013228 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:37.063098 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Getting quotas for project b17a9621d46a4dec8cc4b8946abaa2c9. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:48:37.072760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Getting quotas for user 2e82aeba3f3b4304b0bb938aca6b92b8 and project b17a9621d46a4dec8cc4b8946abaa2c9. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:48:37.106465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Going to run 1 instances... {{(pid=128886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:48:37.118752 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:48:37.317399 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6ee99162-c3b3-438a-a6dd-2ba793b13858 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.326952 May 16 18:48:37.320657 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 1/10] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:48:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 5333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:48:37.332898 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-415aa648-bb3a-4d20-a634-b5aac7a7f80e tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:37.333360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-415aa648-bb3a-4d20-a634-b5aac7a7f80e tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:37.614709 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-efa67498-80d2-4de0-90f0-94ee0dfd3e89 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469bef280>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:37.742531 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-415aa648-bb3a-4d20-a634-b5aac7a7f80e tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:37.788361 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-415aa648-bb3a-4d20-a634-b5aac7a7f80e tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1214 microversion: 2.1 time: 0.459676 May 16 18:48:37.792549 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 10/11] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:37 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1214 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:37.815766 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-efa67498-80d2-4de0-90f0-94ee0dfd3e89 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 200 len: 288 microversion: 2.1 time: 0.239094 May 16 18:48:37.818021 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 2/12] 10.222.0.72 () {58 vars in 1250 bytes} [Mon May 16 18:48:37 2022] GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 288 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:48:37.829942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-696f10ac-5ac8-4af8-ba6e-137d5c8fb818 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469c42940>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:38.210582 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-696f10ac-5ac8-4af8-ba6e-137d5c8fb818 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "DELETE /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 202 len: 0 microversion: 2.1 time: 0.385055 May 16 18:48:38.212295 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 11/13] 10.222.0.72 () {58 vars in 1253 bytes} [Mon May 16 18:48:37 2022] DELETE /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:48:38.221487 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b47065fe-0f63-4da7-9731-5fa59cecad81 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6468b52c10>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:38.285283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b47065fe-0f63-4da7-9731-5fa59cecad81 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 200 len: 287 microversion: 2.1 time: 0.068175 May 16 18:48:38.287575 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 3/14] 10.222.0.72 () {58 vars in 1250 bytes} [Mon May 16 18:48:38 2022] GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:48:38.809661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d4bba119-006e-40ef-b0e2-ae927bed5d05 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:38.810270 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d4bba119-006e-40ef-b0e2-ae927bed5d05 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:39.000721 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d4bba119-006e-40ef-b0e2-ae927bed5d05 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:39.017083 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d4bba119-006e-40ef-b0e2-ae927bed5d05 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1214 microversion: 2.1 time: 0.210886 May 16 18:48:39.019871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 12/15] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:38 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:39.301428 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e746eca3-dd18-48b7-ae3c-e3819e4866ab tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6468b5a310>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:39.379867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e746eca3-dd18-48b7-ae3c-e3819e4866ab tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 200 len: 287 microversion: 2.1 time: 0.082081 May 16 18:48:39.381482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 4/16] 10.222.0.72 () {58 vars in 1250 bytes} [Mon May 16 18:48:39 2022] GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:40.039928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d7a43dfb-4bd4-49a1-b89f-68ec3bfc668c tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:40.048677 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d7a43dfb-4bd4-49a1-b89f-68ec3bfc668c tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:40.090728 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d7a43dfb-4bd4-49a1-b89f-68ec3bfc668c tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:40.092192 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d7a43dfb-4bd4-49a1-b89f-68ec3bfc668c tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:40.107127 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d7a43dfb-4bd4-49a1-b89f-68ec3bfc668c tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:40.109081 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d7a43dfb-4bd4-49a1-b89f-68ec3bfc668c tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:40.397625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-436fdfaa-12e0-4807-bb72-8858f9839151 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6468b52dc0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:40.495688 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-436fdfaa-12e0-4807-bb72-8858f9839151 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 200 len: 287 microversion: 2.1 time: 0.105294 May 16 18:48:40.497169 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 5/17] 10.222.0.72 () {58 vars in 1250 bytes} [Mon May 16 18:48:40 2022] GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:40.543756 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d7a43dfb-4bd4-49a1-b89f-68ec3bfc668c tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:40.585849 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d7a43dfb-4bd4-49a1-b89f-68ec3bfc668c tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1218 microversion: 2.1 time: 0.553523 May 16 18:48:40.595749 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 13/18] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:40 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1218 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:41.512316 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b3dd7195-e829-46e4-9d3a-6c375ce23b1e tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6468b5a550>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:41.607612 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c8257c1f-e539-4708-8b8d-ec4c37468509 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:41.609253 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c8257c1f-e539-4708-8b8d-ec4c37468509 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:41.646242 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b3dd7195-e829-46e4-9d3a-6c375ce23b1e tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 200 len: 287 microversion: 2.1 time: 0.141772 May 16 18:48:41.648403 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 6/19] 10.222.0.72 () {58 vars in 1250 bytes} [Mon May 16 18:48:41 2022] GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:41.649487 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c8257c1f-e539-4708-8b8d-ec4c37468509 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:41.650205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c8257c1f-e539-4708-8b8d-ec4c37468509 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:41.651450 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c8257c1f-e539-4708-8b8d-ec4c37468509 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:41.656714 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c8257c1f-e539-4708-8b8d-ec4c37468509 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:42.294695 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-111fe57f-59dc-4ae6-a451-cdf3d11cc848 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: .version_select at 0x7f6468b5a8b0>, body: {"keypair": {"name": "tempest-keypair-880387144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSrMDujNZK5KpNTAnkZyZbBg61tBw5do1no9QR88j4MmaGVcoRg+obir9bb260nTNN6ngkTi6QhffzZztrIMaE8AMbOTRXeTST41IdvmTojLEQ3Q6WAFhBu3GIIRgJC9g=="}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:42.413594 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-111fe57f-59dc-4ae6-a451-cdf3d11cc848 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:48:42.433065 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-111fe57f-59dc-4ae6-a451-cdf3d11cc848 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for user cd0d8acbe24d410690470e3d9d4882b1 and project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:48:42.547469 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-111fe57f-59dc-4ae6-a451-cdf3d11cc848 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.869159 May 16 18:48:42.548891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 7/20] 10.222.0.72 () {60 vars in 1158 bytes} [Mon May 16 18:48:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:48:42.661783 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6812d285-782a-4af7-80ea-5378d3fa0f80 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6468b5c430>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:42.679198 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c8257c1f-e539-4708-8b8d-ec4c37468509 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:42.687544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c8257c1f-e539-4708-8b8d-ec4c37468509 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1218 microversion: 2.1 time: 1.084131 May 16 18:48:42.701858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 14/21] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:41 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1218 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:42.733033 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-6812d285-782a-4af7-80ea-5378d3fa0f80 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] HTTP exception thrown: Snapshot 80848b10-26a1-4163-bdc8-a3a959398c59 could not be found. May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6812d285-782a-4af7-80ea-5378d3fa0f80 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Request method failure captured: May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 HTTP/1.1 May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpx9c_RyHmWshIX6OsYGZCm7YB4dOXfF4GquHsFSwNPDI0I3WLeAyGycpCx1RWLHy1cqcff32jeVRoYwz-4HodJ8dS8C4M0BSUXZYMS0b84bf7KbUXwd6S-ejxazo3Pr0XM993CwNxp3IMzKwZrx3OzDqdOI7zw3UzuueaTRgh6qHSc May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 332a575667ce44b6a4549a1c81ff4718 May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:48:42.737762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 332a575667ce44b6a4549a1c81ff4718 May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesSnapshotsTestJSON-1121138467-project May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 6661214f6806405d9cecb597d9349f4c May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1121138467-project May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Snapshot 80848b10-26a1-4163-bdc8-a3a959398c59 could not be found. May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '80848b10-26a1-4163-bdc8-a3a959398c59'} May 16 18:48:42.739292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 80848b10-26a1-4163-bdc8-a3a959398c59 could not be found. (HTTP 404) (Request-ID: req-d5f82b7c-696b-47b8-a500-3616ccdd02e0) May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:42.740174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 18:48:42.741184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 80848b10-26a1-4163-bdc8-a3a959398c59 could not be found. May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 16 18:48:42.742921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 80848b10-26a1-4163-bdc8-a3a959398c59 could not be found. May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 80848b10-26a1-4163-bdc8-a3a959398c59 could not be found. May 16 18:48:42.744992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:42.747382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6812d285-782a-4af7-80ea-5378d3fa0f80 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Returning 404 to user: Snapshot 80848b10-26a1-4163-bdc8-a3a959398c59 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:48:42.749440 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6812d285-782a-4af7-80ea-5378d3fa0f80 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59" status: 404 len: 111 microversion: 2.1 time: 0.093825 May 16 18:48:42.752115 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 8/22] 10.222.0.72 () {58 vars in 1250 bytes} [Mon May 16 18:48:42 2022] GET /compute/v2.1/os-snapshots/80848b10-26a1-4163-bdc8-a3a959398c59 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:48:42.762240 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b1641f86-82da-460d-a6e9-f7694127a36c tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469b923a0>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:42.908447 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b1641f86-82da-460d-a6e9-f7694127a36c tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd" status: 202 len: 0 microversion: 2.1 time: 0.150748 May 16 18:48:42.910244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 15/23] 10.222.0.72 () {58 vars in 1247 bytes} [Mon May 16 18:48:42 2022] DELETE /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:48:42.923278 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-de52468a-cf7f-4874-9fad-3aca4d87e881 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469bdeee0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:43.158083 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-de52468a-cf7f-4874-9fad-3aca4d87e881 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd" status: 200 len: 344 microversion: 2.1 time: 0.241297 May 16 18:48:43.159546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 9/24] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:48:42 2022] GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd => generated 344 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:43.710527 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a470713c-4037-4dbe-af7e-a4c7e0509283 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:43.711775 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a470713c-4037-4dbe-af7e-a4c7e0509283 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:43.724318 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a470713c-4037-4dbe-af7e-a4c7e0509283 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:43.725386 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a470713c-4037-4dbe-af7e-a4c7e0509283 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:43.726361 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a470713c-4037-4dbe-af7e-a4c7e0509283 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:43.726943 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a470713c-4037-4dbe-af7e-a4c7e0509283 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:44.042335 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a470713c-4037-4dbe-af7e-a4c7e0509283 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:44.054949 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a470713c-4037-4dbe-af7e-a4c7e0509283 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1272 microversion: 2.1 time: 0.351253 May 16 18:48:44.056943 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 16/25] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:43 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1272 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:44.179371 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-44a3e441-10db-424a-9034-3de92fea17a0 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6468b5c1f0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:44.341727 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-44a3e441-10db-424a-9034-3de92fea17a0 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] HTTP exception thrown: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-44a3e441-10db-424a-9034-3de92fea17a0 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Request method failure captured: May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd HTTP/1.1 May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpx9c_RyHmWshIX6OsYGZCm7YB4dOXfF4GquHsFSwNPDI0I3WLeAyGycpCx1RWLHy1cqcff32jeVRoYwz-4HodJ8dS8C4M0BSUXZYMS0b84bf7KbUXwd6S-ejxazo3Pr0XM993CwNxp3IMzKwZrx3OzDqdOI7zw3UzuueaTRgh6qHSc May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 332a575667ce44b6a4549a1c81ff4718 May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:48:44.345233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 332a575667ce44b6a4549a1c81ff4718 May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesSnapshotsTestJSON-1121138467-project May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 6661214f6806405d9cecb597d9349f4c May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1121138467-project May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '994f2054-f65f-4d59-88e0-876d463eacfd'} May 16 18:48:44.346470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. (HTTP 404) (Request-ID: req-1950e3a4-3282-4336-a4c3-65da99b5dce2) May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:44.347241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 18:48:44.348384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 18:48:44.350089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-44a3e441-10db-424a-9034-3de92fea17a0 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Returning 404 to user: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:48:44.351163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-44a3e441-10db-424a-9034-3de92fea17a0 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd" status: 404 len: 109 microversion: 2.1 time: 0.178663 May 16 18:48:44.363877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2833b2a3-2b01-441c-9597-cefd37cbd6e1 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f6469b928b0>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:44.367236 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 10/26] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:48:44 2022] GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd => generated 109 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:48:44.490890 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-2833b2a3-2b01-441c-9597-cefd37cbd6e1 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] HTTP exception thrown: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2833b2a3-2b01-441c-9597-cefd37cbd6e1 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Request method failure captured: May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: DELETE /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd HTTP/1.1 May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpx9c_RyHmWshIX6OsYGZCm7YB4dOXfF4GquHsFSwNPDI0I3WLeAyGycpCx1RWLHy1cqcff32jeVRoYwz-4HodJ8dS8C4M0BSUXZYMS0b84bf7KbUXwd6S-ejxazo3Pr0XM993CwNxp3IMzKwZrx3OzDqdOI7zw3UzuueaTRgh6qHSc May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 332a575667ce44b6a4549a1c81ff4718 May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:48:44.497075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 332a575667ce44b6a4549a1c81ff4718 May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-VolumesSnapshotsTestJSON-1121138467-project May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 6661214f6806405d9cecb597d9349f4c May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1121138467-project May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '994f2054-f65f-4d59-88e0-876d463eacfd'} May 16 18:48:44.498267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. (HTTP 404) (Request-ID: req-d92ac121-5835-41ef-9cf3-e544a47fe506) May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:44.498964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 18:48:44.500131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 18:48:44.501200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2833b2a3-2b01-441c-9597-cefd37cbd6e1 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Returning 404 to user: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:48:44.502631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2833b2a3-2b01-441c-9597-cefd37cbd6e1 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd" status: 404 len: 109 microversion: 2.1 time: 0.140354 May 16 18:48:44.509526 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ec5bd27f-f161-49c8-84e8-d154034c4282 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Calling method '.version_select at 0x7f64682d8790>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:44.517285 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 17/27] 10.222.0.72 () {58 vars in 1247 bytes} [Mon May 16 18:48:44 2022] DELETE /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:48:44.563654 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-ec5bd27f-f161-49c8-84e8-d154034c4282 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] HTTP exception thrown: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ec5bd27f-f161-49c8-84e8-d154034c4282 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Request method failure captured: May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd HTTP/1.1 May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpx9c_RyHmWshIX6OsYGZCm7YB4dOXfF4GquHsFSwNPDI0I3WLeAyGycpCx1RWLHy1cqcff32jeVRoYwz-4HodJ8dS8C4M0BSUXZYMS0b84bf7KbUXwd6S-ejxazo3Pr0XM993CwNxp3IMzKwZrx3OzDqdOI7zw3UzuueaTRgh6qHSc May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 332a575667ce44b6a4549a1c81ff4718 May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:48:44.569872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/332a575667ce44b6a4549a1c81ff4718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 332a575667ce44b6a4549a1c81ff4718 May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1121138467 May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesSnapshotsTestJSON-1121138467-project May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 6661214f6806405d9cecb597d9349f4c May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1121138467-project May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '994f2054-f65f-4d59-88e0-876d463eacfd'} May 16 18:48:44.571172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. (HTTP 404) (Request-ID: req-146880e8-5749-41cb-9287-0333f9befbc8) May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:44.571910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 18:48:44.572911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 18:48:44.573915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. May 16 18:48:44.574875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:44.576357 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ec5bd27f-f161-49c8-84e8-d154034c4282 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] Returning 404 to user: Volume 994f2054-f65f-4d59-88e0-876d463eacfd could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:48:44.577526 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ec5bd27f-f161-49c8-84e8-d154034c4282 tempest-VolumesSnapshotsTestJSON-1121138467 tempest-VolumesSnapshotsTestJSON-1121138467-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd" status: 404 len: 109 microversion: 2.1 time: 0.073657 May 16 18:48:44.578442 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 11/28] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:48:44 2022] GET /compute/v2.1/os-volumes/994f2054-f65f-4d59-88e0-876d463eacfd => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:48:45.074540 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f9a64d69-c6c6-4d91-8781-1337318eb632 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:45.075157 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f9a64d69-c6c6-4d91-8781-1337318eb632 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:45.099107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9a64d69-c6c6-4d91-8781-1337318eb632 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:45.099107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9a64d69-c6c6-4d91-8781-1337318eb632 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:45.101238 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9a64d69-c6c6-4d91-8781-1337318eb632 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:45.101730 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9a64d69-c6c6-4d91-8781-1337318eb632 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:45.253836 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f9a64d69-c6c6-4d91-8781-1337318eb632 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:45.265858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f9a64d69-c6c6-4d91-8781-1337318eb632 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1272 microversion: 2.1 time: 0.195362 May 16 18:48:45.268424 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 18/29] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:45 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:45.971330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-45e3e2cd-d552-4751-aba8-2a1691245aa8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'create', calling method: .version_select at 0x7f646832ddc0>, body: {"keypair": {"name": "tempest-keypair-515346986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHx7qXbOKGgfFuTG7hN/ft7k9URSKqLn/w5FkDiTMHFBlMrAhdSoYOphDfJhriqKlqQEj+Wh+7rAga/8p1ERSr5GTOb4mOBywUdL1dG0KyaiA/AVaqRZBIdtgUN3jq0yA=="}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:46.050962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-45e3e2cd-d552-4751-aba8-2a1691245aa8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Getting quotas for project 75d882994e2c443fb1d9104ccbfb8c7f. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:48:46.066473 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-45e3e2cd-d552-4751-aba8-2a1691245aa8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Getting quotas for user dab7aa55b2554d338cd76f34d03e1ef2 and project 75d882994e2c443fb1d9104ccbfb8c7f. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:48:46.143153 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-45e3e2cd-d552-4751-aba8-2a1691245aa8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.588979 May 16 18:48:46.147410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 12/30] 10.222.0.72 () {60 vars in 1158 bytes} [Mon May 16 18:48:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:46.289220 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2e9e5f73-8a6e-4694-8f99-a230edd9acb9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:46.290290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2e9e5f73-8a6e-4694-8f99-a230edd9acb9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:46.307402 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2e9e5f73-8a6e-4694-8f99-a230edd9acb9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:46.308018 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2e9e5f73-8a6e-4694-8f99-a230edd9acb9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:46.311230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2e9e5f73-8a6e-4694-8f99-a230edd9acb9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:46.318249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2e9e5f73-8a6e-4694-8f99-a230edd9acb9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:47.581688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2e9e5f73-8a6e-4694-8f99-a230edd9acb9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:47.591432 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2e9e5f73-8a6e-4694-8f99-a230edd9acb9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1272 microversion: 2.1 time: 1.309542 May 16 18:48:47.601007 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 19/31] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:46 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1272 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:48.107564 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4fe8a5ef-823c-4695-a087-3dfd60e94372 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Action: 'create', calling method: .version_select at 0x7f646832dc10>, body: {"keypair": {"name": "tempest-keypair-1130001388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL01i+a6JL+YX5pfOwf1bgR/VEpiX4pS/KYnhtH7ym4cOJPRVoUXrDw57jI2JXgzUz34GbiiAHvUKGwSimIvqt2439qXWJg4UypWBPtnIWRIM+eZFndy/R6ruIbHcvSsrQ=="}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:48.199625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-4fe8a5ef-823c-4695-a087-3dfd60e94372 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Getting quotas for project 67cdad09821341cfa56bbc4642d2cd04. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:48:48.210456 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-4fe8a5ef-823c-4695-a087-3dfd60e94372 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Getting quotas for user 8928566ff693460f8243c43078a6a575 and project 67cdad09821341cfa56bbc4642d2cd04. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:48:48.301576 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-4fe8a5ef-823c-4695-a087-3dfd60e94372 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.460877 May 16 18:48:48.310410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 13/32] 10.222.0.72 () {62 vars in 1199 bytes} [Mon May 16 18:48:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 471 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 18:48:48.619324 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-17861444-46d3-4a63-aa48-68c206a0bfd6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:48.620186 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-17861444-46d3-4a63-aa48-68c206a0bfd6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:48.631422 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-17861444-46d3-4a63-aa48-68c206a0bfd6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:48.632345 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-17861444-46d3-4a63-aa48-68c206a0bfd6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:48.637283 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-17861444-46d3-4a63-aa48-68c206a0bfd6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:48.638084 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-17861444-46d3-4a63-aa48-68c206a0bfd6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:49.025077 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-17861444-46d3-4a63-aa48-68c206a0bfd6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:49.054400 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-17861444-46d3-4a63-aa48-68c206a0bfd6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.439858 May 16 18:48:49.068562 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 20/33] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:48 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:50.073962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a5d8c3d7-2591-44d1-ae5d-d974d1cbeced tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:50.075474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a5d8c3d7-2591-44d1-ae5d-d974d1cbeced tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:50.121000 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a5d8c3d7-2591-44d1-ae5d-d974d1cbeced tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:50.130258 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a5d8c3d7-2591-44d1-ae5d-d974d1cbeced tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:50.138369 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a5d8c3d7-2591-44d1-ae5d-d974d1cbeced tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:50.139366 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a5d8c3d7-2591-44d1-ae5d-d974d1cbeced tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:51.155323 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-643226f4-4158-4d86-9b3b-a11a16074006 tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] Action: 'create', calling method: .version_select at 0x7f6469b994c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1425573200", "metadata": {"Type": "work"}}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:51.725049 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a5d8c3d7-2591-44d1-ae5d-d974d1cbeced tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:51.775465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a5d8c3d7-2591-44d1-ae5d-d974d1cbeced tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 1.705962 May 16 18:48:51.780942 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 14/34] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:50 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:48:52.338263 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-643226f4-4158-4d86-9b3b-a11a16074006 tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.588617 May 16 18:48:52.340528 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 21/35] 10.222.0.72 () {60 vars in 1155 bytes} [Mon May 16 18:48:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1592 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 18:48:52.384173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c4a48da3-ebb3-411e-8d6d-34e42c30c2f8 tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] Calling method '.version_select at 0x7f646826ad30>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:52.744689 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c4a48da3-ebb3-411e-8d6d-34e42c30c2f8 tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae" status: 200 len: 353 microversion: 2.1 time: 0.389897 May 16 18:48:52.751655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 15/36] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:48:52 2022] GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae => generated 353 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:52.797318 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-11987c7b-bed1-429b-807a-bc7187e4b0dc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:52.798060 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-11987c7b-bed1-429b-807a-bc7187e4b0dc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:52.816223 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-11987c7b-bed1-429b-807a-bc7187e4b0dc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:52.824857 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-11987c7b-bed1-429b-807a-bc7187e4b0dc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:52.837369 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-11987c7b-bed1-429b-807a-bc7187e4b0dc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:52.838160 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-11987c7b-bed1-429b-807a-bc7187e4b0dc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:53.760496 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ccc970c7-04d3-4f8c-bc07-57c8d099b421 tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] Calling method '.version_select at 0x7f646821d9d0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:53.879987 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ccc970c7-04d3-4f8c-bc07-57c8d099b421 tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae" status: 200 len: 354 microversion: 2.1 time: 0.125415 May 16 18:48:53.880731 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 16/37] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:48:53 2022] GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:48:53.893342 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bfc78cfa-8ec8-4554-800a-c74e673a6bed tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] Calling method '.version_select at 0x7f646826a670>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:54.031273 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-bfc78cfa-8ec8-4554-800a-c74e673a6bed tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae" status: 200 len: 354 microversion: 2.1 time: 0.141819 May 16 18:48:54.031914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 17/38] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:48:53 2022] GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:48:54.064399 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d51d0d55-18a4-472b-a3dd-d8e16d264ba7 tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] Calling method '.version_select at 0x7f646821d940>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:54.308904 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d51d0d55-18a4-472b-a3dd-d8e16d264ba7 tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae" status: 202 len: 0 microversion: 2.1 time: 0.254367 May 16 18:48:54.309776 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 18/39] 10.222.0.72 () {58 vars in 1247 bytes} [Mon May 16 18:48:54 2022] DELETE /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:48:54.319450 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0093c20f-7d04-4764-ae5d-3dbd4ea886c4 tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] Calling method '.version_select at 0x7f64681b70d0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:54.486295 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0093c20f-7d04-4764-ae5d-3dbd4ea886c4 tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae" status: 200 len: 353 microversion: 2.1 time: 0.172150 May 16 18:48:54.487247 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 19/40] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:48:54 2022] GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:48:55.501470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e28fec78-7a9f-4c4c-99b3-978dcc4e166b tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] Calling method '.version_select at 0x7f646821d5e0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:55.665843 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-e28fec78-7a9f-4c4c-99b3-978dcc4e166b tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] HTTP exception thrown: Volume acf40fac-41aa-459b-a94e-c7fc4249edae could not be found. May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e28fec78-7a9f-4c4c-99b3-978dcc4e166b tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] Request method failure captured: May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae HTTP/1.1 May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpySZBJ4X0OvTGQ5BXQ3oBNfmSm2apGWsDUd1jRU3o0LUj-2nbD5CH8WyLfgkd6xWFk_OUafhH1JzwuDf7HPGfAZ4-Ap_nFo3nFz4Wl7tvVdzVfcqTL5TyrPVSrnfXnd9j2E-dRKK14SD9PulX5pZGGRmwJhQRhhRH60aD_VAGi8ytg May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 3da38b286e004405b81744905dcf74a2 May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesGetTestJSON-177690766 May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:48:55.667947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3da38b286e004405b81744905dcf74a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3da38b286e004405b81744905dcf74a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3da38b286e004405b81744905dcf74a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3da38b286e004405b81744905dcf74a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesGetTestJSON-177690766 May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 3da38b286e004405b81744905dcf74a2 May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesGetTestJSON-177690766 May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesGetTestJSON-177690766-project May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: fe7a2576960f4dfdba2ed7f9ef48f325 May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesGetTestJSON-177690766-project May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Volume acf40fac-41aa-459b-a94e-c7fc4249edae could not be found. May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'acf40fac-41aa-459b-a94e-c7fc4249edae'} May 16 18:48:55.669982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume acf40fac-41aa-459b-a94e-c7fc4249edae could not be found. (HTTP 404) (Request-ID: req-3c262294-8798-47f4-9b69-b360a748d936) May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:55.671495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 18:48:55.672861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume acf40fac-41aa-459b-a94e-c7fc4249edae could not be found. May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 18:48:55.674791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume acf40fac-41aa-459b-a94e-c7fc4249edae could not be found. May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume acf40fac-41aa-459b-a94e-c7fc4249edae could not be found. May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e28fec78-7a9f-4c4c-99b3-978dcc4e166b tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] Returning 404 to user: Volume acf40fac-41aa-459b-a94e-c7fc4249edae could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e28fec78-7a9f-4c4c-99b3-978dcc4e166b tempest-VolumesGetTestJSON-177690766 tempest-VolumesGetTestJSON-177690766-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae" status: 404 len: 109 microversion: 2.1 time: 0.171997 May 16 18:48:55.679400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 20/41] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:48:55 2022] GET /compute/v2.1/os-volumes/acf40fac-41aa-459b-a94e-c7fc4249edae => generated 109 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:48:55.968745 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-11987c7b-bed1-429b-807a-bc7187e4b0dc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:56.009187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-11987c7b-bed1-429b-807a-bc7187e4b0dc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 3.212362 May 16 18:48:56.012162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 22/42] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:52 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 3220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:56.080339 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1217253714", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6559b826-317e-418c-bd4b-dba054fded99"}], "security_groups": [{"name": "tempest-securitygroup--793860696"}], "key_name": "tempest-keypair-1130001388", "user_data": "}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:56.850574 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] validate_networks() for [('6559b826-317e-418c-bd4b-dba054fded99', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:48:57.025583 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-f068b518-3da7-4bee-89a3-873ce0a55a81 req-8575addc-b7fa-4bc9-8a4c-251562280807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "910f83ed-e7ef-4355-8027-d81af4b020c6", "tag": "fbfdd317-119d-4147-970a-8341b34a1205"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:57.105974 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-f068b518-3da7-4bee-89a3-873ce0a55a81 req-8575addc-b7fa-4bc9-8a4c-251562280807 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:57.106812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-f068b518-3da7-4bee-89a3-873ce0a55a81 req-8575addc-b7fa-4bc9-8a4c-251562280807 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:57.152751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-f068b518-3da7-4bee-89a3-873ce0a55a81 req-8575addc-b7fa-4bc9-8a4c-251562280807 service nova] Creating event network-changed:fbfdd317-119d-4147-970a-8341b34a1205 for instance 910f83ed-e7ef-4355-8027-d81af4b020c6 on hv-cinder-75078 May 16 18:48:57.153777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-f068b518-3da7-4bee-89a3-873ce0a55a81 req-8575addc-b7fa-4bc9-8a4c-251562280807 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 18:48:57.158595 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-940ed8cd-eb74-493c-b281-3970ccf5b868 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:57.159090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-940ed8cd-eb74-493c-b281-3970ccf5b868 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:57.175658 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-940ed8cd-eb74-493c-b281-3970ccf5b868 None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:57.176244 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-940ed8cd-eb74-493c-b281-3970ccf5b868 None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:57.210328 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.compute.rpcapi [None req-940ed8cd-eb74-493c-b281-3970ccf5b868 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 18:48:57.212267 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-940ed8cd-eb74-493c-b281-3970ccf5b868 None None] Releasing lock "compute-rpcapi-router" {{(pid=128886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 18:48:57.261453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-940ed8cd-eb74-493c-b281-3970ccf5b868 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.415559 May 16 18:48:57.262161 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 21/43] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:48:57.269546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1ee3004a-e153-4d8e-b05e-1616484db824 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:57.270282 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1ee3004a-e153-4d8e-b05e-1616484db824 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:57.285735 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1ee3004a-e153-4d8e-b05e-1616484db824 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:57.286175 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1ee3004a-e153-4d8e-b05e-1616484db824 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:57.287678 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1ee3004a-e153-4d8e-b05e-1616484db824 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:57.288175 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1ee3004a-e153-4d8e-b05e-1616484db824 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:57.827012 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1ee3004a-e153-4d8e-b05e-1616484db824 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:57.843314 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1ee3004a-e153-4d8e-b05e-1616484db824 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.579752 May 16 18:48:57.850536 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 22/44] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:57 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:57.873370 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-123668817", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "236a317a-f889-44df-b53d-ac5f81a24b24"}], "security_groups": [{"name": "tempest-securitygroup--2075324893"}], "key_name": "tempest-keypair-880387144", "user_data": "}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:58.566858 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.network.neutron [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] validate_networks() for [('236a317a-f889-44df-b53d-ac5f81a24b24', None, None, None, None, None)] {{(pid=128886) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:48:59.185628 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:48:59.186134 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:48:59.186514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:48:59.187330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:48:59.187787 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:48:59.222901 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:59.223362 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:59.224242 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:59.224683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:59.327097 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Getting quotas for project 67cdad09821341cfa56bbc4642d2cd04. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:48:59.342186 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Getting quotas for user 8928566ff693460f8243c43078a6a575 and project 67cdad09821341cfa56bbc4642d2cd04. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:48:59.358962 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:48:59.362963 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:48:59.498469 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3c923026-a1fd-44e4-a53f-6e61b3980473 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.423907 May 16 18:48:59.506356 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 23/45] 10.222.0.72 () {62 vars in 1187 bytes} [Mon May 16 18:48:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 3431 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 16 18:48:59.515188 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-97729297-881c-4d4a-9894-4a68b9470e95 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:59.515879 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-97729297-881c-4d4a-9894-4a68b9470e95 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:59.533337 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-97729297-881c-4d4a-9894-4a68b9470e95 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:59.533801 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-97729297-881c-4d4a-9894-4a68b9470e95 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:59.534935 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-97729297-881c-4d4a-9894-4a68b9470e95 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:59.535187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-97729297-881c-4d4a-9894-4a68b9470e95 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:59.590209 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Flavor limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:48:59.590999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Image limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:48:59.591602 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Flavor pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:48:59.592516 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Image pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:48:59.593233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:48:59.619665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:59.620288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:59.621182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:48:59.621652 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:48:59.677757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:48:59.682860 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for user cd0d8acbe24d410690470e3d9d4882b1 and project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:48:59.726297 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Going to run 1 instances... {{(pid=128886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:48:59.745559 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:48:59.835468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-97729297-881c-4d4a-9894-4a68b9470e95 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:48:59.845237 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-97729297-881c-4d4a-9894-4a68b9470e95 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.337226 May 16 18:48:59.857310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 24/46] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:48:59 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:48:59.857310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-398908192", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "265ca952-32c3-45ee-8297-5b81b68af9fb"}], "security_groups": [{"name": "tempest-securitygroup--308001911"}], "key_name": "tempest-keypair-515346986", "user_data": "}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:48:59.860902 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6d66572a-e389-45e6-9d63-28501dac405a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.008878 May 16 18:48:59.867942 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 23/47] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:48:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:48:59.873998 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bb9a1732-1273-460e-8ac3-34dc0aa78406 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:48:59.874799 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-bb9a1732-1273-460e-8ac3-34dc0aa78406 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:48:59.995898 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bb9a1732-1273-460e-8ac3-34dc0aa78406 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:00.082831 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bb9a1732-1273-460e-8ac3-34dc0aa78406 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:00.086425 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bb9a1732-1273-460e-8ac3-34dc0aa78406 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:00.094318 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-bb9a1732-1273-460e-8ac3-34dc0aa78406 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1282 microversion: 2.20 time: 0.224839 May 16 18:49:00.095802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 24/48] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:48:59 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:00.109795 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7cfd52e1-4d81-42a4-ae72-9d4779a69d09 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:00.114541 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7cfd52e1-4d81-42a4-ae72-9d4779a69d09 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:00.155529 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] validate_networks() for [('265ca952-32c3-45ee-8297-5b81b68af9fb', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:49:00.751878 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7cfd52e1-4d81-42a4-ae72-9d4779a69d09 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:00.767621 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7cfd52e1-4d81-42a4-ae72-9d4779a69d09 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1240 microversion: 2.1 time: 0.666367 May 16 18:49:00.768923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 25/49] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:00 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1240 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:00.866255 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-594c109b-189d-4634-8968-d5bcf62bf7b2 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:00.866979 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-594c109b-189d-4634-8968-d5bcf62bf7b2 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:00.880886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-594c109b-189d-4634-8968-d5bcf62bf7b2 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:00.882762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-594c109b-189d-4634-8968-d5bcf62bf7b2 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:00.884770 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-594c109b-189d-4634-8968-d5bcf62bf7b2 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:00.888577 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-594c109b-189d-4634-8968-d5bcf62bf7b2 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:01.554937 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-594c109b-189d-4634-8968-d5bcf62bf7b2 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:01.566625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-594c109b-189d-4634-8968-d5bcf62bf7b2 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.705304 May 16 18:49:01.569452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 26/50] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:00 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:01.579117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d92c1361-c2e1-4892-b99c-2a9cc2c5ea7b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:01.583539 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d92c1361-c2e1-4892-b99c-2a9cc2c5ea7b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:01.600757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d92c1361-c2e1-4892-b99c-2a9cc2c5ea7b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:01.603988 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d92c1361-c2e1-4892-b99c-2a9cc2c5ea7b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:01.605094 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d92c1361-c2e1-4892-b99c-2a9cc2c5ea7b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:01.608500 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d92c1361-c2e1-4892-b99c-2a9cc2c5ea7b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:01.853502 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d92c1361-c2e1-4892-b99c-2a9cc2c5ea7b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:01.876516 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d92c1361-c2e1-4892-b99c-2a9cc2c5ea7b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:01.899447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d92c1361-c2e1-4892-b99c-2a9cc2c5ea7b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:01.905396 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d92c1361-c2e1-4892-b99c-2a9cc2c5ea7b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1286 microversion: 2.20 time: 0.333762 May 16 18:49:01.910046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 27/51] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:01 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1286 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:01.935917 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6f125b62-a1af-4de6-8f1c-1055e50c6d08 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:01.938428 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6f125b62-a1af-4de6-8f1c-1055e50c6d08 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:01.947221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6f125b62-a1af-4de6-8f1c-1055e50c6d08 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:01.948024 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6f125b62-a1af-4de6-8f1c-1055e50c6d08 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:01.948972 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6f125b62-a1af-4de6-8f1c-1055e50c6d08 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:01.949566 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6f125b62-a1af-4de6-8f1c-1055e50c6d08 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:01.975406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:49:01.976060 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:49:01.976313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:49:01.976735 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:49:01.977127 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:49:02.004940 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:02.005977 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:02.014440 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:02.015297 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:02.035009 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Getting quotas for project 75d882994e2c443fb1d9104ccbfb8c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:49:02.039807 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Getting quotas for user dab7aa55b2554d338cd76f34d03e1ef2 and project 75d882994e2c443fb1d9104ccbfb8c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:49:02.067417 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:49:02.072986 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:49:02.109680 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6f125b62-a1af-4de6-8f1c-1055e50c6d08 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:02.127190 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6f125b62-a1af-4de6-8f1c-1055e50c6d08 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1292 microversion: 2.1 time: 0.215208 May 16 18:49:02.144300 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 28/52] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:01 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1292 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:02.221419 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7c4bb484-3c48-4a7a-a063-e6401fe66da4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.373022 May 16 18:49:02.232540 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 25/53] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:48:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 2385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:49:02.238740 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8f915c36-a65a-4705-8da0-ebca38ec241e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:02.239829 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8f915c36-a65a-4705-8da0-ebca38ec241e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:02.378251 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8f915c36-a65a-4705-8da0-ebca38ec241e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:02.394128 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8f915c36-a65a-4705-8da0-ebca38ec241e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1236 microversion: 2.1 time: 0.160513 May 16 18:49:02.395946 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 29/54] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:02 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1236 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:02.588453 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2c343de8-a733-47e6-8b60-17b971bb54fb tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:02.589726 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2c343de8-a733-47e6-8b60-17b971bb54fb tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:02.600176 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c343de8-a733-47e6-8b60-17b971bb54fb tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:02.600683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c343de8-a733-47e6-8b60-17b971bb54fb tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:02.601459 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c343de8-a733-47e6-8b60-17b971bb54fb tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:02.601844 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c343de8-a733-47e6-8b60-17b971bb54fb tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:02.873745 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2c343de8-a733-47e6-8b60-17b971bb54fb tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:02.891447 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2c343de8-a733-47e6-8b60-17b971bb54fb tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.302598 May 16 18:49:02.892182 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 26/55] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:02 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:02.928730 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-31af494f-f466-46f4-a379-49e09f78f98e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:02.930940 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-31af494f-f466-46f4-a379-49e09f78f98e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:02.940575 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-31af494f-f466-46f4-a379-49e09f78f98e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:02.941382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-31af494f-f466-46f4-a379-49e09f78f98e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:02.943021 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-31af494f-f466-46f4-a379-49e09f78f98e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:02.944485 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-31af494f-f466-46f4-a379-49e09f78f98e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:03.156600 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-879ba234-fd30-45ae-bd74-5413d1124717 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:03.157644 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-879ba234-fd30-45ae-bd74-5413d1124717 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:03.158604 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-31af494f-f466-46f4-a379-49e09f78f98e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:03.175576 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-31af494f-f466-46f4-a379-49e09f78f98e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:03.180841 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-879ba234-fd30-45ae-bd74-5413d1124717 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:03.181092 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-31af494f-f466-46f4-a379-49e09f78f98e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:03.182023 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-31af494f-f466-46f4-a379-49e09f78f98e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1278 microversion: 2.20 time: 0.257533 May 16 18:49:03.183102 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 30/56] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:02 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:49:03.184942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-879ba234-fd30-45ae-bd74-5413d1124717 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:03.186989 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-879ba234-fd30-45ae-bd74-5413d1124717 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:03.198374 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-879ba234-fd30-45ae-bd74-5413d1124717 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:03.326836 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-879ba234-fd30-45ae-bd74-5413d1124717 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:03.335793 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-879ba234-fd30-45ae-bd74-5413d1124717 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1292 microversion: 2.1 time: 0.186521 May 16 18:49:03.343163 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 27/57] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:03 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1292 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:03.436700 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3f9f2e1c-34ef-4cf9-a763-709c0895ee8d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:03.437977 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3f9f2e1c-34ef-4cf9-a763-709c0895ee8d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:03.444293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3f9f2e1c-34ef-4cf9-a763-709c0895ee8d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:03.444746 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3f9f2e1c-34ef-4cf9-a763-709c0895ee8d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:03.445542 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3f9f2e1c-34ef-4cf9-a763-709c0895ee8d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:03.445984 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3f9f2e1c-34ef-4cf9-a763-709c0895ee8d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:03.513961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3f9f2e1c-34ef-4cf9-a763-709c0895ee8d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:03.524132 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3f9f2e1c-34ef-4cf9-a763-709c0895ee8d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1240 microversion: 2.1 time: 0.091295 May 16 18:49:03.524740 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 31/58] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:03 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:03.917260 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c188e568-55fd-4545-80d3-13d356f30392 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:03.918185 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c188e568-55fd-4545-80d3-13d356f30392 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:03.924346 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c188e568-55fd-4545-80d3-13d356f30392 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:03.924901 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c188e568-55fd-4545-80d3-13d356f30392 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:03.925760 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c188e568-55fd-4545-80d3-13d356f30392 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:03.926278 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c188e568-55fd-4545-80d3-13d356f30392 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:04.068832 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c188e568-55fd-4545-80d3-13d356f30392 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:04.076823 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c188e568-55fd-4545-80d3-13d356f30392 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.164000 May 16 18:49:04.081423 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 28/59] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:03 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:04.201076 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9a11c242-8789-476a-bb6b-9bbeda4d9972 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:04.201683 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9a11c242-8789-476a-bb6b-9bbeda4d9972 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:04.211860 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9a11c242-8789-476a-bb6b-9bbeda4d9972 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:04.212442 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9a11c242-8789-476a-bb6b-9bbeda4d9972 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:04.213299 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9a11c242-8789-476a-bb6b-9bbeda4d9972 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:04.213808 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9a11c242-8789-476a-bb6b-9bbeda4d9972 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:04.284568 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9a11c242-8789-476a-bb6b-9bbeda4d9972 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:04.294529 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9a11c242-8789-476a-bb6b-9bbeda4d9972 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:04.296084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9a11c242-8789-476a-bb6b-9bbeda4d9972 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:04.297221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9a11c242-8789-476a-bb6b-9bbeda4d9972 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1278 microversion: 2.20 time: 0.099986 May 16 18:49:04.299771 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 32/60] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:04 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1278 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:04.360407 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-bf38fdb7-e34b-4a7a-9ad1-44fd88a111c1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:04.361593 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-bf38fdb7-e34b-4a7a-9ad1-44fd88a111c1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:04.370961 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bf38fdb7-e34b-4a7a-9ad1-44fd88a111c1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:04.371412 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bf38fdb7-e34b-4a7a-9ad1-44fd88a111c1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:04.374715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bf38fdb7-e34b-4a7a-9ad1-44fd88a111c1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:04.376565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bf38fdb7-e34b-4a7a-9ad1-44fd88a111c1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:04.449065 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bf38fdb7-e34b-4a7a-9ad1-44fd88a111c1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:04.460032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-bf38fdb7-e34b-4a7a-9ad1-44fd88a111c1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1292 microversion: 2.1 time: 0.103343 May 16 18:49:04.460755 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 29/61] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:04 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:04.543003 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5d05fef9-6030-4288-9163-44bbeae7aece tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:04.543539 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5d05fef9-6030-4288-9163-44bbeae7aece tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:04.551302 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d05fef9-6030-4288-9163-44bbeae7aece tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:04.551302 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d05fef9-6030-4288-9163-44bbeae7aece tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:04.552121 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d05fef9-6030-4288-9163-44bbeae7aece tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:04.552548 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d05fef9-6030-4288-9163-44bbeae7aece tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:04.626402 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5d05fef9-6030-4288-9163-44bbeae7aece tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:04.634896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5d05fef9-6030-4288-9163-44bbeae7aece tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1240 microversion: 2.1 time: 0.096047 May 16 18:49:04.644984 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 33/62] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:04 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1240 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:05.094501 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-40692156-166a-4872-b347-09a5aef85cd7 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:05.095310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-40692156-166a-4872-b347-09a5aef85cd7 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:05.101783 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-40692156-166a-4872-b347-09a5aef85cd7 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:05.102249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-40692156-166a-4872-b347-09a5aef85cd7 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:05.103037 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-40692156-166a-4872-b347-09a5aef85cd7 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:05.103515 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-40692156-166a-4872-b347-09a5aef85cd7 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:05.243523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-40692156-166a-4872-b347-09a5aef85cd7 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:05.251000 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-40692156-166a-4872-b347-09a5aef85cd7 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.160280 May 16 18:49:05.252047 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 30/63] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:05 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:05.316946 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4fd5a813-0d87-460b-8a59-1bcceb157ab8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:05.318043 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-4fd5a813-0d87-460b-8a59-1bcceb157ab8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:05.324388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4fd5a813-0d87-460b-8a59-1bcceb157ab8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:05.324582 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4fd5a813-0d87-460b-8a59-1bcceb157ab8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:05.325296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4fd5a813-0d87-460b-8a59-1bcceb157ab8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:05.325717 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4fd5a813-0d87-460b-8a59-1bcceb157ab8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:05.389806 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-4fd5a813-0d87-460b-8a59-1bcceb157ab8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:05.398666 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-4fd5a813-0d87-460b-8a59-1bcceb157ab8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:05.400321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-4fd5a813-0d87-460b-8a59-1bcceb157ab8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:05.401527 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-4fd5a813-0d87-460b-8a59-1bcceb157ab8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1278 microversion: 2.20 time: 0.088299 May 16 18:49:05.402082 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 34/64] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:05 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:49:05.477569 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1e7c103b-4a24-468f-9a61-a1328a363193 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:05.478789 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1e7c103b-4a24-468f-9a61-a1328a363193 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:05.485030 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e7c103b-4a24-468f-9a61-a1328a363193 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:05.485486 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e7c103b-4a24-468f-9a61-a1328a363193 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:05.486265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e7c103b-4a24-468f-9a61-a1328a363193 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:05.486704 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e7c103b-4a24-468f-9a61-a1328a363193 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:05.549947 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1e7c103b-4a24-468f-9a61-a1328a363193 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:05.559930 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1e7c103b-4a24-468f-9a61-a1328a363193 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1292 microversion: 2.1 time: 0.086089 May 16 18:49:05.560959 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 31/65] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:05 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:05.652453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ab3e2c58-96f9-43a5-8d7a-b7d7a6abbe18 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:05.652934 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ab3e2c58-96f9-43a5-8d7a-b7d7a6abbe18 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:05.659067 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ab3e2c58-96f9-43a5-8d7a-b7d7a6abbe18 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:05.659518 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ab3e2c58-96f9-43a5-8d7a-b7d7a6abbe18 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:05.660314 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ab3e2c58-96f9-43a5-8d7a-b7d7a6abbe18 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:05.660754 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ab3e2c58-96f9-43a5-8d7a-b7d7a6abbe18 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:05.725341 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ab3e2c58-96f9-43a5-8d7a-b7d7a6abbe18 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:05.733024 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ab3e2c58-96f9-43a5-8d7a-b7d7a6abbe18 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1240 microversion: 2.1 time: 0.084573 May 16 18:49:05.733694 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 35/66] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:05 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:06.274941 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-04e5025f-59c4-443c-bf6f-057656019b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:06.280149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-04e5025f-59c4-443c-bf6f-057656019b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:06.311179 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-04e5025f-59c4-443c-bf6f-057656019b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:06.314501 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-04e5025f-59c4-443c-bf6f-057656019b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:06.316325 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-04e5025f-59c4-443c-bf6f-057656019b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:06.320383 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-04e5025f-59c4-443c-bf6f-057656019b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:06.426377 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c939def9-3f2e-4c8b-aa41-6ad76659394f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:06.426377 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c939def9-3f2e-4c8b-aa41-6ad76659394f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:06.432430 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c939def9-3f2e-4c8b-aa41-6ad76659394f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:06.433251 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c939def9-3f2e-4c8b-aa41-6ad76659394f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:06.434173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c939def9-3f2e-4c8b-aa41-6ad76659394f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:06.434801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c939def9-3f2e-4c8b-aa41-6ad76659394f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:06.575166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c939def9-3f2e-4c8b-aa41-6ad76659394f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:06.586390 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c939def9-3f2e-4c8b-aa41-6ad76659394f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:06.587983 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c939def9-3f2e-4c8b-aa41-6ad76659394f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:06.589615 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c939def9-3f2e-4c8b-aa41-6ad76659394f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1334 microversion: 2.20 time: 0.172974 May 16 18:49:06.590046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 36/67] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:06 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1334 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:06.594912 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-be7523a2-375b-499c-90ef-7259d4633ba9 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:06.595534 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-be7523a2-375b-499c-90ef-7259d4633ba9 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:06.602457 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be7523a2-375b-499c-90ef-7259d4633ba9 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:06.602950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be7523a2-375b-499c-90ef-7259d4633ba9 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:06.603872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be7523a2-375b-499c-90ef-7259d4633ba9 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:06.604315 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be7523a2-375b-499c-90ef-7259d4633ba9 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:06.660779 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-04e5025f-59c4-443c-bf6f-057656019b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:06.669950 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-04e5025f-59c4-443c-bf6f-057656019b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.404002 May 16 18:49:06.670693 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 32/68] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:06 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:06.690581 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-be7523a2-375b-499c-90ef-7259d4633ba9 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:06.701110 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-be7523a2-375b-499c-90ef-7259d4633ba9 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1300 microversion: 2.1 time: 0.109693 May 16 18:49:06.701705 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 37/69] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:06 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:06.751107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b20047d5-ecb7-4d29-b2cc-c82fc7831a51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:06.752004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b20047d5-ecb7-4d29-b2cc-c82fc7831a51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:06.758556 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b20047d5-ecb7-4d29-b2cc-c82fc7831a51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:06.759012 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b20047d5-ecb7-4d29-b2cc-c82fc7831a51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:06.759808 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b20047d5-ecb7-4d29-b2cc-c82fc7831a51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:06.760249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b20047d5-ecb7-4d29-b2cc-c82fc7831a51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:06.824173 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b20047d5-ecb7-4d29-b2cc-c82fc7831a51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:06.832445 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b20047d5-ecb7-4d29-b2cc-c82fc7831a51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1232 microversion: 2.1 time: 0.085537 May 16 18:49:06.833058 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 33/70] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:06 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1232 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:07.606806 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f99f659c-bcf1-429c-b0bb-8d0fc615103f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:07.607455 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f99f659c-bcf1-429c-b0bb-8d0fc615103f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:07.613560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f99f659c-bcf1-429c-b0bb-8d0fc615103f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:07.614014 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f99f659c-bcf1-429c-b0bb-8d0fc615103f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:07.614807 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f99f659c-bcf1-429c-b0bb-8d0fc615103f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:07.615246 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f99f659c-bcf1-429c-b0bb-8d0fc615103f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:07.679113 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f99f659c-bcf1-429c-b0bb-8d0fc615103f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:07.687250 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f99f659c-bcf1-429c-b0bb-8d0fc615103f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:07.688510 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f0b31bcf-327d-4af3-b90d-fb82bfd0124b tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:07.688980 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f99f659c-bcf1-429c-b0bb-8d0fc615103f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:07.689103 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f0b31bcf-327d-4af3-b90d-fb82bfd0124b tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:07.689859 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f99f659c-bcf1-429c-b0bb-8d0fc615103f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1334 microversion: 2.20 time: 0.087294 May 16 18:49:07.690420 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 38/71] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:07 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:07.695679 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f0b31bcf-327d-4af3-b90d-fb82bfd0124b tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:07.696151 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f0b31bcf-327d-4af3-b90d-fb82bfd0124b tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:07.696914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f0b31bcf-327d-4af3-b90d-fb82bfd0124b tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:07.697344 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f0b31bcf-327d-4af3-b90d-fb82bfd0124b tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:07.718655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-df346acd-add2-48f5-a909-edf7b467e227 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:07.719250 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-df346acd-add2-48f5-a909-edf7b467e227 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:07.725589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-df346acd-add2-48f5-a909-edf7b467e227 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:07.726041 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-df346acd-add2-48f5-a909-edf7b467e227 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:07.726812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-df346acd-add2-48f5-a909-edf7b467e227 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:07.727249 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-df346acd-add2-48f5-a909-edf7b467e227 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:07.793972 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-df346acd-add2-48f5-a909-edf7b467e227 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:07.801524 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-df346acd-add2-48f5-a909-edf7b467e227 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1300 microversion: 2.1 time: 0.086618 May 16 18:49:07.802807 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 39/72] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:07 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:07.850490 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6cc7b8e7-cd24-40f5-a60e-47c3733c36f8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:07.851105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6cc7b8e7-cd24-40f5-a60e-47c3733c36f8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:07.851757 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f0b31bcf-327d-4af3-b90d-fb82bfd0124b tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:07.857248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cc7b8e7-cd24-40f5-a60e-47c3733c36f8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:07.857698 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cc7b8e7-cd24-40f5-a60e-47c3733c36f8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:07.858586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cc7b8e7-cd24-40f5-a60e-47c3733c36f8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:07.859099 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cc7b8e7-cd24-40f5-a60e-47c3733c36f8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:07.859546 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f0b31bcf-327d-4af3-b90d-fb82bfd0124b tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.174691 May 16 18:49:07.860173 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 34/73] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:07 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:07.923031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6cc7b8e7-cd24-40f5-a60e-47c3733c36f8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:07.930995 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6cc7b8e7-cd24-40f5-a60e-47c3733c36f8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1232 microversion: 2.1 time: 0.084703 May 16 18:49:07.933314 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 40/74] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:07 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1232 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:08.708680 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ddac5ac3-f0c9-48fe-aec9-cf06cd95b496 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:08.709385 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ddac5ac3-f0c9-48fe-aec9-cf06cd95b496 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:08.715722 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ddac5ac3-f0c9-48fe-aec9-cf06cd95b496 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:08.716185 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ddac5ac3-f0c9-48fe-aec9-cf06cd95b496 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:08.716966 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ddac5ac3-f0c9-48fe-aec9-cf06cd95b496 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:08.717399 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ddac5ac3-f0c9-48fe-aec9-cf06cd95b496 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:08.782345 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ddac5ac3-f0c9-48fe-aec9-cf06cd95b496 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:08.791252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ddac5ac3-f0c9-48fe-aec9-cf06cd95b496 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:08.792841 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ddac5ac3-f0c9-48fe-aec9-cf06cd95b496 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:08.793988 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ddac5ac3-f0c9-48fe-aec9-cf06cd95b496 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1334 microversion: 2.20 time: 0.089767 May 16 18:49:08.794542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 35/75] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:08 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:08.818786 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-35fcc3ff-3bbe-47b2-8767-10e96e2e4145 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:08.819397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-35fcc3ff-3bbe-47b2-8767-10e96e2e4145 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:08.825385 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35fcc3ff-3bbe-47b2-8767-10e96e2e4145 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:08.825836 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35fcc3ff-3bbe-47b2-8767-10e96e2e4145 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:08.826610 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35fcc3ff-3bbe-47b2-8767-10e96e2e4145 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:08.827046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35fcc3ff-3bbe-47b2-8767-10e96e2e4145 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:08.877355 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b9cc229d-e41a-4552-8ba5-3ea1fd0ddafa tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:08.877971 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b9cc229d-e41a-4552-8ba5-3ea1fd0ddafa tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:08.884592 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9cc229d-e41a-4552-8ba5-3ea1fd0ddafa tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:08.885044 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9cc229d-e41a-4552-8ba5-3ea1fd0ddafa tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:08.885892 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9cc229d-e41a-4552-8ba5-3ea1fd0ddafa tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:08.886397 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9cc229d-e41a-4552-8ba5-3ea1fd0ddafa tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:08.902622 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-35fcc3ff-3bbe-47b2-8767-10e96e2e4145 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:08.910238 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-35fcc3ff-3bbe-47b2-8767-10e96e2e4145 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1300 microversion: 2.1 time: 0.095565 May 16 18:49:08.912474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 41/76] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:08 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:08.948384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0fd4c960-4649-4254-856b-9cf978c90f51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:08.949127 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0fd4c960-4649-4254-856b-9cf978c90f51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:08.955326 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0fd4c960-4649-4254-856b-9cf978c90f51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:08.955802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0fd4c960-4649-4254-856b-9cf978c90f51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:08.956752 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0fd4c960-4649-4254-856b-9cf978c90f51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:08.957187 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0fd4c960-4649-4254-856b-9cf978c90f51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:09.033993 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0fd4c960-4649-4254-856b-9cf978c90f51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:09.042223 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0fd4c960-4649-4254-856b-9cf978c90f51 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1232 microversion: 2.1 time: 0.097722 May 16 18:49:09.052762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 42/77] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:08 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1232 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:09.056789 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b9cc229d-e41a-4552-8ba5-3ea1fd0ddafa tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:09.064280 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b9cc229d-e41a-4552-8ba5-3ea1fd0ddafa tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.190560 May 16 18:49:09.064874 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 36/78] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:08 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:09.811941 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1df9bbcd-f54a-4b0a-8b61-b4f39d1cfdbf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:09.812557 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1df9bbcd-f54a-4b0a-8b61-b4f39d1cfdbf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:09.818907 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1df9bbcd-f54a-4b0a-8b61-b4f39d1cfdbf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:09.819599 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1df9bbcd-f54a-4b0a-8b61-b4f39d1cfdbf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:09.820143 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1df9bbcd-f54a-4b0a-8b61-b4f39d1cfdbf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:09.820575 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1df9bbcd-f54a-4b0a-8b61-b4f39d1cfdbf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:09.885975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1df9bbcd-f54a-4b0a-8b61-b4f39d1cfdbf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:09.893955 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1df9bbcd-f54a-4b0a-8b61-b4f39d1cfdbf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:09.895498 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1df9bbcd-f54a-4b0a-8b61-b4f39d1cfdbf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:09.897262 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1df9bbcd-f54a-4b0a-8b61-b4f39d1cfdbf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1334 microversion: 2.20 time: 0.089286 May 16 18:49:09.897835 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 43/79] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:09 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:09.928882 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8445a255-41d8-4d91-abf3-0d53b7b5c4d3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:09.929507 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8445a255-41d8-4d91-abf3-0d53b7b5c4d3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:09.935673 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8445a255-41d8-4d91-abf3-0d53b7b5c4d3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:09.936156 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8445a255-41d8-4d91-abf3-0d53b7b5c4d3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:09.936929 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8445a255-41d8-4d91-abf3-0d53b7b5c4d3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:09.937368 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8445a255-41d8-4d91-abf3-0d53b7b5c4d3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:09.999699 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8445a255-41d8-4d91-abf3-0d53b7b5c4d3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:10.008161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8445a255-41d8-4d91-abf3-0d53b7b5c4d3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1300 microversion: 2.1 time: 0.083752 May 16 18:49:10.008748 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 37/80] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:09 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:10.060506 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f61341d8-97b5-4a96-b2c2-94e9801d06e9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:10.061119 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f61341d8-97b5-4a96-b2c2-94e9801d06e9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:10.067415 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f61341d8-97b5-4a96-b2c2-94e9801d06e9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:10.068087 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f61341d8-97b5-4a96-b2c2-94e9801d06e9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:10.068878 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f61341d8-97b5-4a96-b2c2-94e9801d06e9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:10.069351 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f61341d8-97b5-4a96-b2c2-94e9801d06e9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:10.080900 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4d512f50-9b30-4f50-8cf0-5e33f6d7a3e8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:10.081500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4d512f50-9b30-4f50-8cf0-5e33f6d7a3e8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:10.088760 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4d512f50-9b30-4f50-8cf0-5e33f6d7a3e8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:10.089209 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4d512f50-9b30-4f50-8cf0-5e33f6d7a3e8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:10.089903 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4d512f50-9b30-4f50-8cf0-5e33f6d7a3e8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:10.090333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4d512f50-9b30-4f50-8cf0-5e33f6d7a3e8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:10.149209 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f61341d8-97b5-4a96-b2c2-94e9801d06e9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:10.157207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f61341d8-97b5-4a96-b2c2-94e9801d06e9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1232 microversion: 2.1 time: 0.100612 May 16 18:49:10.158082 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 44/81] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:10 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1232 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:10.251291 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4d512f50-9b30-4f50-8cf0-5e33f6d7a3e8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:10.258633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4d512f50-9b30-4f50-8cf0-5e33f6d7a3e8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.181585 May 16 18:49:10.259215 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 38/82] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:10 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:10.914987 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c36f6621-5a60-4a6f-8f30-d630aa372407 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:10.915669 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c36f6621-5a60-4a6f-8f30-d630aa372407 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:10.923031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c36f6621-5a60-4a6f-8f30-d630aa372407 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:10.923660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c36f6621-5a60-4a6f-8f30-d630aa372407 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:10.924476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c36f6621-5a60-4a6f-8f30-d630aa372407 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:10.924909 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c36f6621-5a60-4a6f-8f30-d630aa372407 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:11.003622 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c36f6621-5a60-4a6f-8f30-d630aa372407 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:11.011940 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c36f6621-5a60-4a6f-8f30-d630aa372407 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:11.013462 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c36f6621-5a60-4a6f-8f30-d630aa372407 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:11.014601 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c36f6621-5a60-4a6f-8f30-d630aa372407 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1334 microversion: 2.20 time: 0.103858 May 16 18:49:11.015170 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 45/83] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:10 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:11.025552 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ffce303b-c7d1-4815-83b1-4c6eb159d99f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:11.026175 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ffce303b-c7d1-4815-83b1-4c6eb159d99f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:11.034438 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ffce303b-c7d1-4815-83b1-4c6eb159d99f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:11.034438 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ffce303b-c7d1-4815-83b1-4c6eb159d99f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:11.034438 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ffce303b-c7d1-4815-83b1-4c6eb159d99f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:11.034438 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ffce303b-c7d1-4815-83b1-4c6eb159d99f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:11.102690 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ffce303b-c7d1-4815-83b1-4c6eb159d99f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:11.114797 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ffce303b-c7d1-4815-83b1-4c6eb159d99f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1300 microversion: 2.1 time: 0.092503 May 16 18:49:11.115755 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 39/84] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:11 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:11.180193 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4ae31949-5e82-4133-846d-b5e8d7355b0c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:11.181018 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-4ae31949-5e82-4133-846d-b5e8d7355b0c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:11.187374 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ae31949-5e82-4133-846d-b5e8d7355b0c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:11.187851 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ae31949-5e82-4133-846d-b5e8d7355b0c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:11.188642 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ae31949-5e82-4133-846d-b5e8d7355b0c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:11.189114 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ae31949-5e82-4133-846d-b5e8d7355b0c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:11.254011 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-4ae31949-5e82-4133-846d-b5e8d7355b0c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:11.264872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-4ae31949-5e82-4133-846d-b5e8d7355b0c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1232 microversion: 2.1 time: 0.091885 May 16 18:49:11.265477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 46/85] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:11 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1232 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:11.276833 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4372e045-86cf-4a49-b568-4fbc8d8f1382 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:11.277449 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4372e045-86cf-4a49-b568-4fbc8d8f1382 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:11.283546 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4372e045-86cf-4a49-b568-4fbc8d8f1382 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:11.284036 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4372e045-86cf-4a49-b568-4fbc8d8f1382 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:11.284813 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4372e045-86cf-4a49-b568-4fbc8d8f1382 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:11.285246 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4372e045-86cf-4a49-b568-4fbc8d8f1382 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:11.424846 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4372e045-86cf-4a49-b568-4fbc8d8f1382 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:11.432910 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4372e045-86cf-4a49-b568-4fbc8d8f1382 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.159868 May 16 18:49:11.433513 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 40/86] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:11 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:12.033151 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0805c768-18c6-4f39-8cb4-2d941a04156d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:12.033754 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0805c768-18c6-4f39-8cb4-2d941a04156d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:12.040740 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0805c768-18c6-4f39-8cb4-2d941a04156d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:12.041194 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0805c768-18c6-4f39-8cb4-2d941a04156d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:12.041971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0805c768-18c6-4f39-8cb4-2d941a04156d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:12.042407 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0805c768-18c6-4f39-8cb4-2d941a04156d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:12.107144 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0805c768-18c6-4f39-8cb4-2d941a04156d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:12.116128 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0805c768-18c6-4f39-8cb4-2d941a04156d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:12.117629 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0805c768-18c6-4f39-8cb4-2d941a04156d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:12.118733 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0805c768-18c6-4f39-8cb4-2d941a04156d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1334 microversion: 2.20 time: 0.089535 May 16 18:49:12.119295 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 47/87] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:12 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:12.135934 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7e9a84c0-0600-4c2f-ab73-5c675300d9a2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:12.136554 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7e9a84c0-0600-4c2f-ab73-5c675300d9a2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:12.142869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7e9a84c0-0600-4c2f-ab73-5c675300d9a2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:12.143320 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7e9a84c0-0600-4c2f-ab73-5c675300d9a2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:12.144141 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7e9a84c0-0600-4c2f-ab73-5c675300d9a2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:12.144574 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7e9a84c0-0600-4c2f-ab73-5c675300d9a2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:12.210253 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7e9a84c0-0600-4c2f-ab73-5c675300d9a2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:12.218339 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7e9a84c0-0600-4c2f-ab73-5c675300d9a2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1300 microversion: 2.1 time: 0.086290 May 16 18:49:12.218942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 41/88] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:12 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:12.282885 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-cbbf26b2-276a-4f8a-95b7-b494fbc7c01e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:12.283541 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-cbbf26b2-276a-4f8a-95b7-b494fbc7c01e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:12.291139 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cbbf26b2-276a-4f8a-95b7-b494fbc7c01e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:12.291696 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cbbf26b2-276a-4f8a-95b7-b494fbc7c01e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:12.292526 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cbbf26b2-276a-4f8a-95b7-b494fbc7c01e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:12.292970 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cbbf26b2-276a-4f8a-95b7-b494fbc7c01e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:12.359283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cbbf26b2-276a-4f8a-95b7-b494fbc7c01e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:12.367020 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-cbbf26b2-276a-4f8a-95b7-b494fbc7c01e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1232 microversion: 2.1 time: 0.088019 May 16 18:49:12.367605 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 48/89] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:12 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1232 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:12.451322 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c474e07a-e7dc-49c5-940a-a64bafaf03a6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:12.451970 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c474e07a-e7dc-49c5-940a-a64bafaf03a6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:12.460020 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c474e07a-e7dc-49c5-940a-a64bafaf03a6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:12.460409 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c474e07a-e7dc-49c5-940a-a64bafaf03a6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:12.461233 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c474e07a-e7dc-49c5-940a-a64bafaf03a6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:12.461672 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c474e07a-e7dc-49c5-940a-a64bafaf03a6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:12.602073 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c474e07a-e7dc-49c5-940a-a64bafaf03a6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:12.611438 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c474e07a-e7dc-49c5-940a-a64bafaf03a6 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.164387 May 16 18:49:12.612054 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 42/90] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:12 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:13.142573 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-32dee4c6-87d6-4b0f-b2c9-4284e0cc5088 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:13.149590 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-32dee4c6-87d6-4b0f-b2c9-4284e0cc5088 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:13.169368 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32dee4c6-87d6-4b0f-b2c9-4284e0cc5088 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:13.170055 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32dee4c6-87d6-4b0f-b2c9-4284e0cc5088 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:13.171150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32dee4c6-87d6-4b0f-b2c9-4284e0cc5088 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:13.171774 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32dee4c6-87d6-4b0f-b2c9-4284e0cc5088 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:13.238701 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-220ad4ce-4fa4-4ec9-b097-9696a14f413b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:13.240573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-220ad4ce-4fa4-4ec9-b097-9696a14f413b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:13.247799 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-220ad4ce-4fa4-4ec9-b097-9696a14f413b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:13.248254 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-220ad4ce-4fa4-4ec9-b097-9696a14f413b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:13.249229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-220ad4ce-4fa4-4ec9-b097-9696a14f413b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:13.249659 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-220ad4ce-4fa4-4ec9-b097-9696a14f413b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:13.257915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-32dee4c6-87d6-4b0f-b2c9-4284e0cc5088 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:13.266608 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-32dee4c6-87d6-4b0f-b2c9-4284e0cc5088 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:13.268174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-32dee4c6-87d6-4b0f-b2c9-4284e0cc5088 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:13.269512 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-32dee4c6-87d6-4b0f-b2c9-4284e0cc5088 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1334 microversion: 2.20 time: 0.136006 May 16 18:49:13.270091 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 49/91] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:13 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1334 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:13.329794 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-220ad4ce-4fa4-4ec9-b097-9696a14f413b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:13.338772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-220ad4ce-4fa4-4ec9-b097-9696a14f413b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1310 microversion: 2.1 time: 0.104613 May 16 18:49:13.339602 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 43/92] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:13 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:13.387788 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ffca59fd-07b7-4096-81cd-c119b7f1c0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:13.388656 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ffca59fd-07b7-4096-81cd-c119b7f1c0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:13.394804 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ffca59fd-07b7-4096-81cd-c119b7f1c0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:13.395238 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ffca59fd-07b7-4096-81cd-c119b7f1c0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:13.396097 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ffca59fd-07b7-4096-81cd-c119b7f1c0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:13.396746 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ffca59fd-07b7-4096-81cd-c119b7f1c0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:13.462665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ffca59fd-07b7-4096-81cd-c119b7f1c0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:13.470479 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ffca59fd-07b7-4096-81cd-c119b7f1c0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1288 microversion: 2.1 time: 0.087027 May 16 18:49:13.471056 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 50/93] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:13 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:13.629451 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c4cbe889-5989-4c4b-95f7-244cf4d66137 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:13.630612 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c4cbe889-5989-4c4b-95f7-244cf4d66137 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:13.636757 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4cbe889-5989-4c4b-95f7-244cf4d66137 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:13.637203 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4cbe889-5989-4c4b-95f7-244cf4d66137 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:13.638097 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4cbe889-5989-4c4b-95f7-244cf4d66137 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:13.638529 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4cbe889-5989-4c4b-95f7-244cf4d66137 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:13.773695 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c4cbe889-5989-4c4b-95f7-244cf4d66137 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:13.781281 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c4cbe889-5989-4c4b-95f7-244cf4d66137 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.155760 May 16 18:49:13.781914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 44/94] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:13 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:14.289121 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-64a032df-db1c-49c9-a9bd-dfb34a7ddd28 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:14.289746 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-64a032df-db1c-49c9-a9bd-dfb34a7ddd28 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:14.296441 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64a032df-db1c-49c9-a9bd-dfb34a7ddd28 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:14.296897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64a032df-db1c-49c9-a9bd-dfb34a7ddd28 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:14.297681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64a032df-db1c-49c9-a9bd-dfb34a7ddd28 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:14.298116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64a032df-db1c-49c9-a9bd-dfb34a7ddd28 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:14.356988 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4fc41946-5736-4ac9-a9e6-49cfc6454cb2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:14.357778 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4fc41946-5736-4ac9-a9e6-49cfc6454cb2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:14.364950 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4fc41946-5736-4ac9-a9e6-49cfc6454cb2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:14.365352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-64a032df-db1c-49c9-a9bd-dfb34a7ddd28 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:14.365525 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4fc41946-5736-4ac9-a9e6-49cfc6454cb2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:14.366401 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4fc41946-5736-4ac9-a9e6-49cfc6454cb2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:14.366901 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4fc41946-5736-4ac9-a9e6-49cfc6454cb2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:14.374030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-64a032df-db1c-49c9-a9bd-dfb34a7ddd28 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:14.375580 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-64a032df-db1c-49c9-a9bd-dfb34a7ddd28 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:14.376878 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-64a032df-db1c-49c9-a9bd-dfb34a7ddd28 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1334 microversion: 2.20 time: 0.092225 May 16 18:49:14.377484 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 51/95] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:14 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:14.432619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4fc41946-5736-4ac9-a9e6-49cfc6454cb2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:14.441637 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4fc41946-5736-4ac9-a9e6-49cfc6454cb2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1310 microversion: 2.1 time: 0.088687 May 16 18:49:14.442486 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 45/96] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:14 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:14.488072 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-90117ec0-1106-4735-8177-d9ec014bbd8e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:14.488763 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-90117ec0-1106-4735-8177-d9ec014bbd8e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:14.495522 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-90117ec0-1106-4735-8177-d9ec014bbd8e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:14.495999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-90117ec0-1106-4735-8177-d9ec014bbd8e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:14.496767 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-90117ec0-1106-4735-8177-d9ec014bbd8e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:14.497196 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-90117ec0-1106-4735-8177-d9ec014bbd8e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:14.560674 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-90117ec0-1106-4735-8177-d9ec014bbd8e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:14.568630 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-90117ec0-1106-4735-8177-d9ec014bbd8e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1288 microversion: 2.1 time: 0.084387 May 16 18:49:14.569236 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 52/97] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:14 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:14.798666 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b9b29f34-2096-4cdc-876c-ea316b37f793 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:14.799283 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b9b29f34-2096-4cdc-876c-ea316b37f793 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:14.805635 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9b29f34-2096-4cdc-876c-ea316b37f793 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:14.806079 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9b29f34-2096-4cdc-876c-ea316b37f793 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:14.806910 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9b29f34-2096-4cdc-876c-ea316b37f793 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:14.807340 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9b29f34-2096-4cdc-876c-ea316b37f793 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:14.953298 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b9b29f34-2096-4cdc-876c-ea316b37f793 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:14.966056 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b9b29f34-2096-4cdc-876c-ea316b37f793 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.170943 May 16 18:49:14.966657 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 46/98] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:14 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:15.395838 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2b0de014-66d7-42ae-aa8e-13e4835eb994 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:15.396658 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2b0de014-66d7-42ae-aa8e-13e4835eb994 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:15.403028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2b0de014-66d7-42ae-aa8e-13e4835eb994 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:15.403474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2b0de014-66d7-42ae-aa8e-13e4835eb994 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:15.404314 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2b0de014-66d7-42ae-aa8e-13e4835eb994 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:15.404745 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2b0de014-66d7-42ae-aa8e-13e4835eb994 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:15.458793 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-36e24970-49e8-406d-a6bb-b5294b9f011e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:15.459580 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-36e24970-49e8-406d-a6bb-b5294b9f011e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:15.469321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36e24970-49e8-406d-a6bb-b5294b9f011e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:15.469753 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36e24970-49e8-406d-a6bb-b5294b9f011e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:15.470532 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36e24970-49e8-406d-a6bb-b5294b9f011e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:15.470704 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2b0de014-66d7-42ae-aa8e-13e4835eb994 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:15.470964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36e24970-49e8-406d-a6bb-b5294b9f011e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:15.480730 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2b0de014-66d7-42ae-aa8e-13e4835eb994 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:15.482485 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2b0de014-66d7-42ae-aa8e-13e4835eb994 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:15.483734 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2b0de014-66d7-42ae-aa8e-13e4835eb994 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1334 microversion: 2.20 time: 0.092209 May 16 18:49:15.484405 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 53/99] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:15 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:15.542764 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-36e24970-49e8-406d-a6bb-b5294b9f011e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:15.550704 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-36e24970-49e8-406d-a6bb-b5294b9f011e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1310 microversion: 2.1 time: 0.096013 May 16 18:49:15.551296 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 47/100] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:15 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:15.586006 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-88fbad65-9bd2-45d5-af59-ddb9047af956 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:15.586620 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-88fbad65-9bd2-45d5-af59-ddb9047af956 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:15.593186 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-88fbad65-9bd2-45d5-af59-ddb9047af956 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:15.593646 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-88fbad65-9bd2-45d5-af59-ddb9047af956 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:15.594420 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-88fbad65-9bd2-45d5-af59-ddb9047af956 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:15.594855 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-88fbad65-9bd2-45d5-af59-ddb9047af956 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:15.657347 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-88fbad65-9bd2-45d5-af59-ddb9047af956 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:15.665830 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-88fbad65-9bd2-45d5-af59-ddb9047af956 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1288 microversion: 2.1 time: 0.084322 May 16 18:49:15.666415 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 54/101] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:15 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:15.989730 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-da6f40d5-2600-480e-86e7-f9cbd2a74918 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:15.990924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-da6f40d5-2600-480e-86e7-f9cbd2a74918 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:16.001693 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da6f40d5-2600-480e-86e7-f9cbd2a74918 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:16.002646 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da6f40d5-2600-480e-86e7-f9cbd2a74918 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:16.004103 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da6f40d5-2600-480e-86e7-f9cbd2a74918 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:16.005659 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da6f40d5-2600-480e-86e7-f9cbd2a74918 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:16.466177 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-da6f40d5-2600-480e-86e7-f9cbd2a74918 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:16.476292 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-da6f40d5-2600-480e-86e7-f9cbd2a74918 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.494295 May 16 18:49:16.477155 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 48/102] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:15 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:16.502797 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-cebd8547-732c-467e-8e58-8a9a15002e9f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:16.504280 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-cebd8547-732c-467e-8e58-8a9a15002e9f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:16.512033 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cebd8547-732c-467e-8e58-8a9a15002e9f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:16.512582 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cebd8547-732c-467e-8e58-8a9a15002e9f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:16.513505 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cebd8547-732c-467e-8e58-8a9a15002e9f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:16.513996 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cebd8547-732c-467e-8e58-8a9a15002e9f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:16.569075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6d3284d1-e10c-4885-95a1-81d7b5e30b13 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:16.569773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6d3284d1-e10c-4885-95a1-81d7b5e30b13 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:16.576796 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d3284d1-e10c-4885-95a1-81d7b5e30b13 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:16.577364 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d3284d1-e10c-4885-95a1-81d7b5e30b13 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:16.578276 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d3284d1-e10c-4885-95a1-81d7b5e30b13 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:16.579400 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d3284d1-e10c-4885-95a1-81d7b5e30b13 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:16.666692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cebd8547-732c-467e-8e58-8a9a15002e9f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:16.679185 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cebd8547-732c-467e-8e58-8a9a15002e9f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:16.680861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cebd8547-732c-467e-8e58-8a9a15002e9f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:16.682031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-cebd8547-732c-467e-8e58-8a9a15002e9f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1342 microversion: 2.20 time: 0.183372 May 16 18:49:16.682931 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 55/103] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:16 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1342 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:16.688459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8c6bf225-99b0-431f-b89d-f227a6c43aae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:16.689271 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8c6bf225-99b0-431f-b89d-f227a6c43aae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:16.696215 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c6bf225-99b0-431f-b89d-f227a6c43aae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:16.696669 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c6bf225-99b0-431f-b89d-f227a6c43aae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:16.697459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c6bf225-99b0-431f-b89d-f227a6c43aae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:16.697909 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c6bf225-99b0-431f-b89d-f227a6c43aae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:16.720004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6d3284d1-e10c-4885-95a1-81d7b5e30b13 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:16.732658 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6d3284d1-e10c-4885-95a1-81d7b5e30b13 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1298 microversion: 2.1 time: 0.167951 May 16 18:49:16.733791 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 49/104] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:16 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1298 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:16.784280 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8c6bf225-99b0-431f-b89d-f227a6c43aae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:16.793438 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8c6bf225-99b0-431f-b89d-f227a6c43aae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1296 microversion: 2.1 time: 0.108932 May 16 18:49:16.794030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 56/105] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:16 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:17.494602 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-20ae5ed0-e44d-4706-ba86-f527ce3cd2cc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:17.495188 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-20ae5ed0-e44d-4706-ba86-f527ce3cd2cc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:17.501133 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-20ae5ed0-e44d-4706-ba86-f527ce3cd2cc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:17.501578 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-20ae5ed0-e44d-4706-ba86-f527ce3cd2cc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:17.502344 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-20ae5ed0-e44d-4706-ba86-f527ce3cd2cc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:17.502766 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-20ae5ed0-e44d-4706-ba86-f527ce3cd2cc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:17.634764 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-20ae5ed0-e44d-4706-ba86-f527ce3cd2cc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:17.642477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-20ae5ed0-e44d-4706-ba86-f527ce3cd2cc tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.151758 May 16 18:49:17.643062 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 50/106] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:17 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:17.700901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d782aa4d-6fbf-494c-832a-4b9875ef8d11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:17.701494 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d782aa4d-6fbf-494c-832a-4b9875ef8d11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:17.707603 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d782aa4d-6fbf-494c-832a-4b9875ef8d11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:17.708086 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d782aa4d-6fbf-494c-832a-4b9875ef8d11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:17.708858 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d782aa4d-6fbf-494c-832a-4b9875ef8d11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:17.709294 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d782aa4d-6fbf-494c-832a-4b9875ef8d11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:17.752948 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c4eac13f-f195-49e2-a8fa-d941beba8966 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:17.753453 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c4eac13f-f195-49e2-a8fa-d941beba8966 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:17.760048 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4eac13f-f195-49e2-a8fa-d941beba8966 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:17.760496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4eac13f-f195-49e2-a8fa-d941beba8966 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:17.761263 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4eac13f-f195-49e2-a8fa-d941beba8966 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:17.761697 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4eac13f-f195-49e2-a8fa-d941beba8966 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:17.773052 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d782aa4d-6fbf-494c-832a-4b9875ef8d11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:17.781166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d782aa4d-6fbf-494c-832a-4b9875ef8d11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:17.782670 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d782aa4d-6fbf-494c-832a-4b9875ef8d11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:17.783933 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d782aa4d-6fbf-494c-832a-4b9875ef8d11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1342 microversion: 2.20 time: 0.086828 May 16 18:49:17.784501 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 57/107] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:17 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:17.811367 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3deb2800-d2f2-47cc-8f49-b2626e1cce31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:17.811989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3deb2800-d2f2-47cc-8f49-b2626e1cce31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:17.818155 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3deb2800-d2f2-47cc-8f49-b2626e1cce31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:17.818596 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3deb2800-d2f2-47cc-8f49-b2626e1cce31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:17.819363 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3deb2800-d2f2-47cc-8f49-b2626e1cce31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:17.819820 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3deb2800-d2f2-47cc-8f49-b2626e1cce31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:17.891678 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3deb2800-d2f2-47cc-8f49-b2626e1cce31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:17.899818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3deb2800-d2f2-47cc-8f49-b2626e1cce31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1296 microversion: 2.1 time: 0.092187 May 16 18:49:17.900408 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 58/108] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:17 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:17.920277 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c4eac13f-f195-49e2-a8fa-d941beba8966 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:17.927922 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c4eac13f-f195-49e2-a8fa-d941beba8966 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.178920 May 16 18:49:17.928514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 51/109] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:17 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:18.660190 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a2368368-0067-45ae-9b99-0a934eb3f16a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:18.661424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a2368368-0067-45ae-9b99-0a934eb3f16a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:18.667605 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a2368368-0067-45ae-9b99-0a934eb3f16a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:18.668080 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a2368368-0067-45ae-9b99-0a934eb3f16a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:18.668843 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a2368368-0067-45ae-9b99-0a934eb3f16a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:18.669272 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a2368368-0067-45ae-9b99-0a934eb3f16a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:18.803639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7300908f-2a00-4e83-bf2a-923f87c89629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:18.804359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7300908f-2a00-4e83-bf2a-923f87c89629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:18.804961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a2368368-0067-45ae-9b99-0a934eb3f16a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:18.810484 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7300908f-2a00-4e83-bf2a-923f87c89629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:18.810935 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7300908f-2a00-4e83-bf2a-923f87c89629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:18.811733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7300908f-2a00-4e83-bf2a-923f87c89629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:18.812176 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7300908f-2a00-4e83-bf2a-923f87c89629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:18.812453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a2368368-0067-45ae-9b99-0a934eb3f16a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.156095 May 16 18:49:18.813034 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 59/110] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:18 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:18.878251 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7300908f-2a00-4e83-bf2a-923f87c89629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:18.886771 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7300908f-2a00-4e83-bf2a-923f87c89629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:18.888544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7300908f-2a00-4e83-bf2a-923f87c89629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:18.889777 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7300908f-2a00-4e83-bf2a-923f87c89629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1342 microversion: 2.20 time: 0.090843 May 16 18:49:18.890374 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 52/111] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:18 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:49:18.917148 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-08267626-0fe9-420b-88e3-00458f55b722 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:18.917679 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-08267626-0fe9-420b-88e3-00458f55b722 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:18.923967 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08267626-0fe9-420b-88e3-00458f55b722 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:18.924421 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08267626-0fe9-420b-88e3-00458f55b722 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:18.925200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08267626-0fe9-420b-88e3-00458f55b722 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:18.925672 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08267626-0fe9-420b-88e3-00458f55b722 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:18.945471 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1e49c72f-2550-4d67-bbd2-57229f344af4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:18.946231 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1e49c72f-2550-4d67-bbd2-57229f344af4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:18.952260 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e49c72f-2550-4d67-bbd2-57229f344af4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:18.952714 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e49c72f-2550-4d67-bbd2-57229f344af4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:18.953497 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e49c72f-2550-4d67-bbd2-57229f344af4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:18.953936 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e49c72f-2550-4d67-bbd2-57229f344af4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:18.993295 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-08267626-0fe9-420b-88e3-00458f55b722 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:19.009080 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-08267626-0fe9-420b-88e3-00458f55b722 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1296 microversion: 2.1 time: 0.095865 May 16 18:49:19.009968 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 60/112] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:18 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:19.155226 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1e49c72f-2550-4d67-bbd2-57229f344af4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:19.175021 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1e49c72f-2550-4d67-bbd2-57229f344af4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.234140 May 16 18:49:19.193127 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 53/113] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:18 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:19.831516 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-cea787fe-a99a-4632-8f4c-0cbee85cff41 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:19.834095 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-cea787fe-a99a-4632-8f4c-0cbee85cff41 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:19.843045 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cea787fe-a99a-4632-8f4c-0cbee85cff41 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:19.844160 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cea787fe-a99a-4632-8f4c-0cbee85cff41 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:19.845291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cea787fe-a99a-4632-8f4c-0cbee85cff41 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:19.845997 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cea787fe-a99a-4632-8f4c-0cbee85cff41 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:19.929453 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8d146194-dc14-4f59-af07-96f39214343f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:19.933667 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8d146194-dc14-4f59-af07-96f39214343f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:19.963660 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8d146194-dc14-4f59-af07-96f39214343f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:19.966484 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8d146194-dc14-4f59-af07-96f39214343f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:19.975770 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8d146194-dc14-4f59-af07-96f39214343f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:19.979201 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8d146194-dc14-4f59-af07-96f39214343f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:20.167322 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8d146194-dc14-4f59-af07-96f39214343f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:20.186913 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8d146194-dc14-4f59-af07-96f39214343f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:20.188906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8d146194-dc14-4f59-af07-96f39214343f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:20.190034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8d146194-dc14-4f59-af07-96f39214343f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1340 microversion: 2.20 time: 0.283913 May 16 18:49:20.196632 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 54/114] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:19 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1340 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:49:20.201598 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0dd52cac-bc04-4bb1-908b-3798a2804048 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:20.210004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0dd52cac-bc04-4bb1-908b-3798a2804048 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:20.217471 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0dd52cac-bc04-4bb1-908b-3798a2804048 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:20.217931 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0dd52cac-bc04-4bb1-908b-3798a2804048 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:20.218715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0dd52cac-bc04-4bb1-908b-3798a2804048 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:20.219415 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0dd52cac-bc04-4bb1-908b-3798a2804048 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:20.338222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0dd52cac-bc04-4bb1-908b-3798a2804048 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:20.346106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0dd52cac-bc04-4bb1-908b-3798a2804048 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1294 microversion: 2.1 time: 0.148344 May 16 18:49:20.349288 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 55/115] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:20 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1294 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:20.371971 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-04b43f1a-277d-46a7-9fca-bc985597496a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:20.375106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-04b43f1a-277d-46a7-9fca-bc985597496a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:20.391259 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-04b43f1a-277d-46a7-9fca-bc985597496a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:20.399055 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-04b43f1a-277d-46a7-9fca-bc985597496a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:20.399055 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-04b43f1a-277d-46a7-9fca-bc985597496a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:20.399055 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-04b43f1a-277d-46a7-9fca-bc985597496a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:20.458481 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cea787fe-a99a-4632-8f4c-0cbee85cff41 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:20.470290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-cea787fe-a99a-4632-8f4c-0cbee85cff41 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.644955 May 16 18:49:20.474399 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 61/116] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:19 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:20.651836 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-04b43f1a-277d-46a7-9fca-bc985597496a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:20.660407 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-04b43f1a-277d-46a7-9fca-bc985597496a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.296903 May 16 18:49:20.663041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 56/117] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:20 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:21.209846 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-71e35831-3767-4b1d-8190-d19a5a45ef38 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:21.211568 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-71e35831-3767-4b1d-8190-d19a5a45ef38 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:21.231263 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-71e35831-3767-4b1d-8190-d19a5a45ef38 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:21.237202 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-71e35831-3767-4b1d-8190-d19a5a45ef38 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:21.246813 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-71e35831-3767-4b1d-8190-d19a5a45ef38 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:21.247264 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-71e35831-3767-4b1d-8190-d19a5a45ef38 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:21.366533 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-bae85a17-a72e-4fd7-902f-519d36fc139d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:21.367155 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-bae85a17-a72e-4fd7-902f-519d36fc139d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:21.386539 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bae85a17-a72e-4fd7-902f-519d36fc139d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:21.389593 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bae85a17-a72e-4fd7-902f-519d36fc139d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:21.391629 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bae85a17-a72e-4fd7-902f-519d36fc139d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:21.397698 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bae85a17-a72e-4fd7-902f-519d36fc139d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:21.972075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-71e35831-3767-4b1d-8190-d19a5a45ef38 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:21.984912 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bae85a17-a72e-4fd7-902f-519d36fc139d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:21.987806 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-71e35831-3767-4b1d-8190-d19a5a45ef38 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:21.990685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-71e35831-3767-4b1d-8190-d19a5a45ef38 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:21.992577 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-71e35831-3767-4b1d-8190-d19a5a45ef38 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.787200 May 16 18:49:22.004343 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 62/118] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:21 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:22.006985 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-bae85a17-a72e-4fd7-902f-519d36fc139d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.645536 May 16 18:49:22.008595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 57/119] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:21 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:22.019553 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4cfe22ae-5a48-4719-bb2f-b07c2ff2221d tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:22.021332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-4cfe22ae-5a48-4719-bb2f-b07c2ff2221d tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:22.029488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4cfe22ae-5a48-4719-bb2f-b07c2ff2221d tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:22.030304 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4cfe22ae-5a48-4719-bb2f-b07c2ff2221d tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:22.031310 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4cfe22ae-5a48-4719-bb2f-b07c2ff2221d tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:22.032627 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4cfe22ae-5a48-4719-bb2f-b07c2ff2221d tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:22.137351 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-12716b23-e70a-4be1-b20b-31615e908c7f req-db941c04-4c17-4d06-81df-822bf8fa5811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec82e115-5ca8-47de-ba42-405096ec5d98", "tag": "f4c32d27-4431-4863-bb69-09faf2b82b93"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:22.154677 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-12716b23-e70a-4be1-b20b-31615e908c7f req-db941c04-4c17-4d06-81df-822bf8fa5811 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:22.170262 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-12716b23-e70a-4be1-b20b-31615e908c7f req-db941c04-4c17-4d06-81df-822bf8fa5811 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:22.272910 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-12716b23-e70a-4be1-b20b-31615e908c7f req-db941c04-4c17-4d06-81df-822bf8fa5811 service nova] Creating event network-changed:f4c32d27-4431-4863-bb69-09faf2b82b93 for instance ec82e115-5ca8-47de-ba42-405096ec5d98 on hv-cinder-75078 May 16 18:49:22.273369 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-12716b23-e70a-4be1-b20b-31615e908c7f req-db941c04-4c17-4d06-81df-822bf8fa5811 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 18:49:22.274510 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-154c0142-0ce6-49e0-8581-2707b892f95d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:22.274942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-154c0142-0ce6-49e0-8581-2707b892f95d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:22.276389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-154c0142-0ce6-49e0-8581-2707b892f95d None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:22.276991 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-154c0142-0ce6-49e0-8581-2707b892f95d None None] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:22.287576 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.compute.rpcapi [None req-154c0142-0ce6-49e0-8581-2707b892f95d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 18:49:22.288739 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-154c0142-0ce6-49e0-8581-2707b892f95d None None] Releasing lock "compute-rpcapi-router" {{(pid=128887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 18:49:22.319570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-154c0142-0ce6-49e0-8581-2707b892f95d None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.306959 May 16 18:49:22.320321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 58/120] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:49:22.331150 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2c3ec3f7-ffd2-4579-943b-81901364c140 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:22.333993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2c3ec3f7-ffd2-4579-943b-81901364c140 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:22.346890 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c3ec3f7-ffd2-4579-943b-81901364c140 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:22.347801 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c3ec3f7-ffd2-4579-943b-81901364c140 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:22.349662 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c3ec3f7-ffd2-4579-943b-81901364c140 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:22.350420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c3ec3f7-ffd2-4579-943b-81901364c140 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:22.387316 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-4cfe22ae-5a48-4719-bb2f-b07c2ff2221d tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:22.402752 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-4cfe22ae-5a48-4719-bb2f-b07c2ff2221d tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.396103 May 16 18:49:22.403384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 63/121] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:22 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:22.562103 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-99787246-531f-4491-9c82-8225a9f689bd req-bcde1466-0cb2-4cb1-ab17-dea8fd942263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910f83ed-e7ef-4355-8027-d81af4b020c6", "name": "network-vif-plugged", "status": "completed", "tag": "fbfdd317-119d-4147-970a-8341b34a1205"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:22.575236 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-99787246-531f-4491-9c82-8225a9f689bd req-bcde1466-0cb2-4cb1-ab17-dea8fd942263 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:22.576036 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-99787246-531f-4491-9c82-8225a9f689bd req-bcde1466-0cb2-4cb1-ab17-dea8fd942263 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:22.591092 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-99787246-531f-4491-9c82-8225a9f689bd req-bcde1466-0cb2-4cb1-ab17-dea8fd942263 service nova] Creating event network-vif-plugged:fbfdd317-119d-4147-970a-8341b34a1205 for instance 910f83ed-e7ef-4355-8027-d81af4b020c6 on hv-cinder-75078 May 16 18:49:22.602422 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-99787246-531f-4491-9c82-8225a9f689bd req-bcde1466-0cb2-4cb1-ab17-dea8fd942263 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194354 May 16 18:49:22.605836 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 64/122] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:49:22.733449 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2c3ec3f7-ffd2-4579-943b-81901364c140 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:22.759684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2c3ec3f7-ffd2-4579-943b-81901364c140 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.437776 May 16 18:49:22.773604 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 59/123] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:22 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:22.889244 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-92997dab-5b78-402d-8489-73ba6193607d req-bb85e923-cd9f-4d03-8b61-2d48d8290341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de1432f-5419-4150-84a0-0fe456962ce9", "tag": "eeb3fe2b-d9aa-4852-85f0-2e9f90328234"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:22.909073 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-92997dab-5b78-402d-8489-73ba6193607d req-bb85e923-cd9f-4d03-8b61-2d48d8290341 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:22.926033 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-92997dab-5b78-402d-8489-73ba6193607d req-bb85e923-cd9f-4d03-8b61-2d48d8290341 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:22.974634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-92997dab-5b78-402d-8489-73ba6193607d req-bb85e923-cd9f-4d03-8b61-2d48d8290341 service nova] Creating event network-changed:eeb3fe2b-d9aa-4852-85f0-2e9f90328234 for instance 4de1432f-5419-4150-84a0-0fe456962ce9 on hv-cinder-75078 May 16 18:49:22.988316 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-92997dab-5b78-402d-8489-73ba6193607d req-bb85e923-cd9f-4d03-8b61-2d48d8290341 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117768 May 16 18:49:22.989691 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 65/124] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:49:23.014420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-18053793-5613-437e-bd3a-1dc0695169f1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:23.015259 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-18053793-5613-437e-bd3a-1dc0695169f1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:23.029939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3b3c12b0-7863-4eab-a1dd-48c790394b21 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:23.030829 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3b3c12b0-7863-4eab-a1dd-48c790394b21 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:23.056092 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b3c12b0-7863-4eab-a1dd-48c790394b21 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:23.058080 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b3c12b0-7863-4eab-a1dd-48c790394b21 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:23.059640 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b3c12b0-7863-4eab-a1dd-48c790394b21 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:23.060815 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b3c12b0-7863-4eab-a1dd-48c790394b21 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:23.086111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-18053793-5613-437e-bd3a-1dc0695169f1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:23.086674 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-18053793-5613-437e-bd3a-1dc0695169f1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:23.087525 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-18053793-5613-437e-bd3a-1dc0695169f1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:23.087999 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-18053793-5613-437e-bd3a-1dc0695169f1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:23.473049 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3b3c12b0-7863-4eab-a1dd-48c790394b21 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:23.482471 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3b3c12b0-7863-4eab-a1dd-48c790394b21 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.459000 May 16 18:49:23.483075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 66/125] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:23 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:23.498554 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-84c858ba-fbd2-44de-a969-23c425c8fc99 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:23.498554 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-84c858ba-fbd2-44de-a969-23c425c8fc99 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:23.506475 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-18053793-5613-437e-bd3a-1dc0695169f1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:23.517655 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-18053793-5613-437e-bd3a-1dc0695169f1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:23.519147 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-18053793-5613-437e-bd3a-1dc0695169f1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:23.523197 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-84c858ba-fbd2-44de-a969-23c425c8fc99 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:23.523657 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-84c858ba-fbd2-44de-a969-23c425c8fc99 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:23.524476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-84c858ba-fbd2-44de-a969-23c425c8fc99 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:23.524914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-84c858ba-fbd2-44de-a969-23c425c8fc99 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:23.528482 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-18053793-5613-437e-bd3a-1dc0695169f1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.511887 May 16 18:49:23.544692 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 60/126] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:23 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:23.711600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-84c858ba-fbd2-44de-a969-23c425c8fc99 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:23.720049 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-84c858ba-fbd2-44de-a969-23c425c8fc99 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.235820 May 16 18:49:23.720742 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 67/127] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:23 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:23.796755 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-abb849de-b87a-46b8-9ea0-54b9a4d80118 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:23.797908 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-abb849de-b87a-46b8-9ea0-54b9a4d80118 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:23.805035 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-abb849de-b87a-46b8-9ea0-54b9a4d80118 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:23.805469 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-abb849de-b87a-46b8-9ea0-54b9a4d80118 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:23.806244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-abb849de-b87a-46b8-9ea0-54b9a4d80118 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:23.806673 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-abb849de-b87a-46b8-9ea0-54b9a4d80118 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:23.958252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-abb849de-b87a-46b8-9ea0-54b9a4d80118 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:23.967275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-abb849de-b87a-46b8-9ea0-54b9a4d80118 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.174429 May 16 18:49:23.967908 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 61/128] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:23 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:24.513302 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-82b69213-5083-44f5-90c4-7865a5abff76 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:24.513905 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-82b69213-5083-44f5-90c4-7865a5abff76 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:24.520737 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-82b69213-5083-44f5-90c4-7865a5abff76 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:24.521195 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-82b69213-5083-44f5-90c4-7865a5abff76 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:24.522169 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-82b69213-5083-44f5-90c4-7865a5abff76 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:24.522886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-82b69213-5083-44f5-90c4-7865a5abff76 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:24.557776 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a9a6d43b-3d46-4d2a-b6e0-5a0c8c9c6786 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:24.558700 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a9a6d43b-3d46-4d2a-b6e0-5a0c8c9c6786 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:24.568229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a9a6d43b-3d46-4d2a-b6e0-5a0c8c9c6786 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:24.568696 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a9a6d43b-3d46-4d2a-b6e0-5a0c8c9c6786 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:24.569509 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a9a6d43b-3d46-4d2a-b6e0-5a0c8c9c6786 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:24.570054 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a9a6d43b-3d46-4d2a-b6e0-5a0c8c9c6786 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:24.776015 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-82b69213-5083-44f5-90c4-7865a5abff76 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:24.783111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a9a6d43b-3d46-4d2a-b6e0-5a0c8c9c6786 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:24.791559 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-82b69213-5083-44f5-90c4-7865a5abff76 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.282357 May 16 18:49:24.792281 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a9a6d43b-3d46-4d2a-b6e0-5a0c8c9c6786 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:24.792670 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 68/129] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:24 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:24.794062 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a9a6d43b-3d46-4d2a-b6e0-5a0c8c9c6786 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:24.795236 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a9a6d43b-3d46-4d2a-b6e0-5a0c8c9c6786 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.241754 May 16 18:49:24.796066 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 62/130] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:24 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:49:24.797792 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8414a5eb-604e-4c56-aacc-f80476d7a19a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:24.798397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8414a5eb-604e-4c56-aacc-f80476d7a19a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:24.807358 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8414a5eb-604e-4c56-aacc-f80476d7a19a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:24.808105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8414a5eb-604e-4c56-aacc-f80476d7a19a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:24.809101 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8414a5eb-604e-4c56-aacc-f80476d7a19a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:24.809737 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8414a5eb-604e-4c56-aacc-f80476d7a19a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:24.986110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9cac30b9-9433-4b05-8af5-dd4daa6febda tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:24.986726 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9cac30b9-9433-4b05-8af5-dd4daa6febda tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:24.994031 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9cac30b9-9433-4b05-8af5-dd4daa6febda tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:24.994477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9cac30b9-9433-4b05-8af5-dd4daa6febda tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:24.995252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9cac30b9-9433-4b05-8af5-dd4daa6febda tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:24.995685 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9cac30b9-9433-4b05-8af5-dd4daa6febda tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:25.016323 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8414a5eb-604e-4c56-aacc-f80476d7a19a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:25.024831 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8414a5eb-604e-4c56-aacc-f80476d7a19a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.230827 May 16 18:49:25.025683 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 69/131] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:24 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:25.030419 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-038e4092-13f0-4f6f-8c8d-3fecc555785d req-da411c6a-47e6-4ec3-b98f-4618fa7564a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5e49a3-f392-4cd6-9856-4b5367c2d5e2", "tag": "b440849e-31ba-4612-a125-9eec9ce576a6"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:25.039362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-038e4092-13f0-4f6f-8c8d-3fecc555785d req-da411c6a-47e6-4ec3-b98f-4618fa7564a9 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:25.039842 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-038e4092-13f0-4f6f-8c8d-3fecc555785d req-da411c6a-47e6-4ec3-b98f-4618fa7564a9 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:25.053040 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-038e4092-13f0-4f6f-8c8d-3fecc555785d req-da411c6a-47e6-4ec3-b98f-4618fa7564a9 service nova] Creating event network-changed:b440849e-31ba-4612-a125-9eec9ce576a6 for instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 on hv-cinder-75078 May 16 18:49:25.058171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-038e4092-13f0-4f6f-8c8d-3fecc555785d req-da411c6a-47e6-4ec3-b98f-4618fa7564a9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031167 May 16 18:49:25.059013 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 70/132] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:49:25.169389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9cac30b9-9433-4b05-8af5-dd4daa6febda tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:25.177906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9cac30b9-9433-4b05-8af5-dd4daa6febda tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.195699 May 16 18:49:25.179756 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 63/133] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:24 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:25.818598 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9f6a8018-41bb-4091-bd9f-3adf2ccd4c63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:25.819290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9f6a8018-41bb-4091-bd9f-3adf2ccd4c63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:25.820426 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-090fb46d-023c-48b5-88f7-06402926e5dc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:25.821148 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-090fb46d-023c-48b5-88f7-06402926e5dc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:25.827034 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9f6a8018-41bb-4091-bd9f-3adf2ccd4c63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:25.827642 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9f6a8018-41bb-4091-bd9f-3adf2ccd4c63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:25.828173 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-090fb46d-023c-48b5-88f7-06402926e5dc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:25.828718 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-090fb46d-023c-48b5-88f7-06402926e5dc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:25.829084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9f6a8018-41bb-4091-bd9f-3adf2ccd4c63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:25.829518 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9f6a8018-41bb-4091-bd9f-3adf2ccd4c63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:25.830464 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-090fb46d-023c-48b5-88f7-06402926e5dc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:25.831114 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-090fb46d-023c-48b5-88f7-06402926e5dc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:26.123029 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-090fb46d-023c-48b5-88f7-06402926e5dc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:26.140414 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-090fb46d-023c-48b5-88f7-06402926e5dc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:26.140773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9f6a8018-41bb-4091-bd9f-3adf2ccd4c63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:26.142771 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-090fb46d-023c-48b5-88f7-06402926e5dc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:26.144228 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-090fb46d-023c-48b5-88f7-06402926e5dc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.328575 May 16 18:49:26.145595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 64/134] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:25 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:26.153714 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9f6a8018-41bb-4091-bd9f-3adf2ccd4c63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.339148 May 16 18:49:26.154065 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1254a462-60f4-42c4-88e2-cb85ea2e3b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:26.154798 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 71/135] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:25 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:26.156929 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1254a462-60f4-42c4-88e2-cb85ea2e3b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:26.168972 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1254a462-60f4-42c4-88e2-cb85ea2e3b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:26.169755 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1254a462-60f4-42c4-88e2-cb85ea2e3b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:26.171408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1254a462-60f4-42c4-88e2-cb85ea2e3b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:26.172183 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1254a462-60f4-42c4-88e2-cb85ea2e3b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:26.201605 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-fc42466e-00c8-4af7-b49c-ccaaffa2517e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:26.202133 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-fc42466e-00c8-4af7-b49c-ccaaffa2517e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:26.209510 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fc42466e-00c8-4af7-b49c-ccaaffa2517e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:26.209967 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fc42466e-00c8-4af7-b49c-ccaaffa2517e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:26.214664 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fc42466e-00c8-4af7-b49c-ccaaffa2517e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:26.214664 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fc42466e-00c8-4af7-b49c-ccaaffa2517e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:26.448858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1254a462-60f4-42c4-88e2-cb85ea2e3b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:26.458751 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1254a462-60f4-42c4-88e2-cb85ea2e3b06 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.310466 May 16 18:49:26.460489 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 65/136] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:26 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:26.461118 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-fc42466e-00c8-4af7-b49c-ccaaffa2517e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:26.475402 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-fc42466e-00c8-4af7-b49c-ccaaffa2517e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.278035 May 16 18:49:26.476831 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 72/137] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:26 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:27.170735 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-425908bf-4f8b-4749-ab76-159a9a5af2bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:27.172199 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-425908bf-4f8b-4749-ab76-159a9a5af2bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:27.174357 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6cbc14ac-6854-4953-b87a-38df683319b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:27.175030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6cbc14ac-6854-4953-b87a-38df683319b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:27.187450 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-425908bf-4f8b-4749-ab76-159a9a5af2bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:27.188976 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-425908bf-4f8b-4749-ab76-159a9a5af2bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:27.190955 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-425908bf-4f8b-4749-ab76-159a9a5af2bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:27.191320 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cbc14ac-6854-4953-b87a-38df683319b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:27.192496 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cbc14ac-6854-4953-b87a-38df683319b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:27.193461 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-425908bf-4f8b-4749-ab76-159a9a5af2bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:27.194227 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cbc14ac-6854-4953-b87a-38df683319b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:27.194675 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cbc14ac-6854-4953-b87a-38df683319b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:27.450930 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6cbc14ac-6854-4953-b87a-38df683319b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:27.471216 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6cbc14ac-6854-4953-b87a-38df683319b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.295197 May 16 18:49:27.474714 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 73/138] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:27 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:27.479894 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9ca7cb29-e245-4466-aaf2-51d73f467406 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:27.480775 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9ca7cb29-e245-4466-aaf2-51d73f467406 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:27.491785 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ca7cb29-e245-4466-aaf2-51d73f467406 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:27.492903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ca7cb29-e245-4466-aaf2-51d73f467406 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:27.493861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ca7cb29-e245-4466-aaf2-51d73f467406 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:27.494337 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ca7cb29-e245-4466-aaf2-51d73f467406 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:27.522909 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-425908bf-4f8b-4749-ab76-159a9a5af2bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:27.532807 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-425908bf-4f8b-4749-ab76-159a9a5af2bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:27.534336 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-425908bf-4f8b-4749-ab76-159a9a5af2bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:27.537877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-425908bf-4f8b-4749-ab76-159a9a5af2bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.378305 May 16 18:49:27.543304 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 66/139] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:27 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:27.546469 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f875c44c-86de-4663-beff-d9225feddda2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:27.547080 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f875c44c-86de-4663-beff-d9225feddda2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:27.574095 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f875c44c-86de-4663-beff-d9225feddda2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:27.575078 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f875c44c-86de-4663-beff-d9225feddda2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:27.580107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f875c44c-86de-4663-beff-d9225feddda2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:27.580767 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f875c44c-86de-4663-beff-d9225feddda2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:27.795878 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f875c44c-86de-4663-beff-d9225feddda2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:27.808474 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f875c44c-86de-4663-beff-d9225feddda2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.265346 May 16 18:49:27.810210 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 67/140] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:27 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:27.855289 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9ca7cb29-e245-4466-aaf2-51d73f467406 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:27.863580 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9ca7cb29-e245-4466-aaf2-51d73f467406 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.387737 May 16 18:49:27.874291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 74/141] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:27 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:28.491753 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-23335938-94b8-46a0-9e4f-02c01cd8654d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:28.492294 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-23335938-94b8-46a0-9e4f-02c01cd8654d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:28.502477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-23335938-94b8-46a0-9e4f-02c01cd8654d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:28.503229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-23335938-94b8-46a0-9e4f-02c01cd8654d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:28.505145 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-23335938-94b8-46a0-9e4f-02c01cd8654d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:28.505941 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-23335938-94b8-46a0-9e4f-02c01cd8654d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:28.561989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-17044659-91fe-4e55-ac0c-cc5e27899953 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:28.562745 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-17044659-91fe-4e55-ac0c-cc5e27899953 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:28.569698 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-17044659-91fe-4e55-ac0c-cc5e27899953 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:28.570444 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-17044659-91fe-4e55-ac0c-cc5e27899953 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:28.571407 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-17044659-91fe-4e55-ac0c-cc5e27899953 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:28.571872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-17044659-91fe-4e55-ac0c-cc5e27899953 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:28.699054 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-23335938-94b8-46a0-9e4f-02c01cd8654d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:28.706843 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-23335938-94b8-46a0-9e4f-02c01cd8654d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.219115 May 16 18:49:28.708157 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 68/142] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:28 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:28.755518 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-17044659-91fe-4e55-ac0c-cc5e27899953 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:28.764327 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-17044659-91fe-4e55-ac0c-cc5e27899953 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:28.766209 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-17044659-91fe-4e55-ac0c-cc5e27899953 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:28.767504 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-17044659-91fe-4e55-ac0c-cc5e27899953 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.209363 May 16 18:49:28.768143 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 75/143] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:28 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:49:28.837301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-557910e2-cff6-4e44-b26f-87900207fc1f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:28.837948 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-557910e2-cff6-4e44-b26f-87900207fc1f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:28.845111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-557910e2-cff6-4e44-b26f-87900207fc1f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:28.845610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-557910e2-cff6-4e44-b26f-87900207fc1f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:28.846384 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-557910e2-cff6-4e44-b26f-87900207fc1f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:28.846819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-557910e2-cff6-4e44-b26f-87900207fc1f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:28.883545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8b0f2e6e-337d-4507-a093-5ef5b96be3c4 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:28.884896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8b0f2e6e-337d-4507-a093-5ef5b96be3c4 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:28.895213 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8b0f2e6e-337d-4507-a093-5ef5b96be3c4 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:28.896058 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8b0f2e6e-337d-4507-a093-5ef5b96be3c4 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:28.897075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8b0f2e6e-337d-4507-a093-5ef5b96be3c4 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:28.897779 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8b0f2e6e-337d-4507-a093-5ef5b96be3c4 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:29.079458 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-557910e2-cff6-4e44-b26f-87900207fc1f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:29.089635 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-557910e2-cff6-4e44-b26f-87900207fc1f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.256448 May 16 18:49:29.100162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 69/144] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:28 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:29.125376 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8b0f2e6e-337d-4507-a093-5ef5b96be3c4 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:29.135198 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8b0f2e6e-337d-4507-a093-5ef5b96be3c4 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.258186 May 16 18:49:29.136138 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 76/145] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:28 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:29.725073 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d3d896ab-18eb-4e19-b108-7da117de3439 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:29.726418 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d3d896ab-18eb-4e19-b108-7da117de3439 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:29.733278 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3d896ab-18eb-4e19-b108-7da117de3439 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:29.733827 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3d896ab-18eb-4e19-b108-7da117de3439 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:29.734873 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3d896ab-18eb-4e19-b108-7da117de3439 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:29.735383 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3d896ab-18eb-4e19-b108-7da117de3439 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:29.792729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7e091c45-f9c5-4fce-87ee-1594449d4403 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:29.793420 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7e091c45-f9c5-4fce-87ee-1594449d4403 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:29.817499 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7e091c45-f9c5-4fce-87ee-1594449d4403 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:29.818028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7e091c45-f9c5-4fce-87ee-1594449d4403 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:29.819521 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7e091c45-f9c5-4fce-87ee-1594449d4403 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:29.820721 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7e091c45-f9c5-4fce-87ee-1594449d4403 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:29.937464 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d3d896ab-18eb-4e19-b108-7da117de3439 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:29.946691 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d3d896ab-18eb-4e19-b108-7da117de3439 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.225840 May 16 18:49:29.947269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 70/146] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:29 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:30.018306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7e091c45-f9c5-4fce-87ee-1594449d4403 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:30.028880 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7e091c45-f9c5-4fce-87ee-1594449d4403 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:30.031480 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7e091c45-f9c5-4fce-87ee-1594449d4403 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:30.032708 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7e091c45-f9c5-4fce-87ee-1594449d4403 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.249872 May 16 18:49:30.033297 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 77/147] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:29 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:49:30.107960 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0cd9930d-f8ee-4c29-b508-ab74b75ab61d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:30.108804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0cd9930d-f8ee-4c29-b508-ab74b75ab61d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:30.115348 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0cd9930d-f8ee-4c29-b508-ab74b75ab61d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:30.115832 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0cd9930d-f8ee-4c29-b508-ab74b75ab61d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:30.116601 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0cd9930d-f8ee-4c29-b508-ab74b75ab61d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:30.117030 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0cd9930d-f8ee-4c29-b508-ab74b75ab61d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:30.155611 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-55a4445f-f747-49c7-af56-b0040c07ec77 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:30.156247 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-55a4445f-f747-49c7-af56-b0040c07ec77 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:30.165290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-55a4445f-f747-49c7-af56-b0040c07ec77 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:30.166210 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-55a4445f-f747-49c7-af56-b0040c07ec77 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:30.167254 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-55a4445f-f747-49c7-af56-b0040c07ec77 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:30.167918 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-55a4445f-f747-49c7-af56-b0040c07ec77 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:30.306279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0cd9930d-f8ee-4c29-b508-ab74b75ab61d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:30.315176 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0cd9930d-f8ee-4c29-b508-ab74b75ab61d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.211278 May 16 18:49:30.315798 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 71/148] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:30 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:30.357622 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-55a4445f-f747-49c7-af56-b0040c07ec77 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:30.372940 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-55a4445f-f747-49c7-af56-b0040c07ec77 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1314 microversion: 2.1 time: 0.222109 May 16 18:49:30.374162 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 78/149] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:30 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:30.972416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d26117cc-ebdd-42a0-9eef-6fc6c34b95dd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:30.974518 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d26117cc-ebdd-42a0-9eef-6fc6c34b95dd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:30.986220 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d26117cc-ebdd-42a0-9eef-6fc6c34b95dd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:30.986967 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d26117cc-ebdd-42a0-9eef-6fc6c34b95dd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:30.988447 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d26117cc-ebdd-42a0-9eef-6fc6c34b95dd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:30.990057 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d26117cc-ebdd-42a0-9eef-6fc6c34b95dd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:31.056194 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f5e6bea5-b9eb-4240-80e2-8486a2e0082a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:31.057277 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f5e6bea5-b9eb-4240-80e2-8486a2e0082a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:31.082689 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f5e6bea5-b9eb-4240-80e2-8486a2e0082a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:31.083428 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f5e6bea5-b9eb-4240-80e2-8486a2e0082a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:31.086317 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f5e6bea5-b9eb-4240-80e2-8486a2e0082a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:31.087537 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f5e6bea5-b9eb-4240-80e2-8486a2e0082a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:31.455785 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d26117cc-ebdd-42a0-9eef-6fc6c34b95dd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:31.478711 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d26117cc-ebdd-42a0-9eef-6fc6c34b95dd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.518117 May 16 18:49:31.479816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 72/150] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:30 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:31.486460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d3a2c34c-1129-4d86-99c4-425d6b52a4a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:31.487573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d3a2c34c-1129-4d86-99c4-425d6b52a4a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:31.495588 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3a2c34c-1129-4d86-99c4-425d6b52a4a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:31.496317 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3a2c34c-1129-4d86-99c4-425d6b52a4a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:31.497307 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3a2c34c-1129-4d86-99c4-425d6b52a4a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:31.497923 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3a2c34c-1129-4d86-99c4-425d6b52a4a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:31.949417 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f5e6bea5-b9eb-4240-80e2-8486a2e0082a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:31.961697 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f5e6bea5-b9eb-4240-80e2-8486a2e0082a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:31.976776 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f5e6bea5-b9eb-4240-80e2-8486a2e0082a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:31.977953 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f5e6bea5-b9eb-4240-80e2-8486a2e0082a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.930145 May 16 18:49:31.989945 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 79/151] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:31 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:32.008548 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-eaf20c82-b172-49aa-8ed2-fd627f36e3ef tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:32.009266 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-eaf20c82-b172-49aa-8ed2-fd627f36e3ef tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:32.016647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eaf20c82-b172-49aa-8ed2-fd627f36e3ef tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:32.017284 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eaf20c82-b172-49aa-8ed2-fd627f36e3ef tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:32.018991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eaf20c82-b172-49aa-8ed2-fd627f36e3ef tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:32.019510 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eaf20c82-b172-49aa-8ed2-fd627f36e3ef tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:32.029305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d3a2c34c-1129-4d86-99c4-425d6b52a4a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:32.039960 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d3a2c34c-1129-4d86-99c4-425d6b52a4a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.557162 May 16 18:49:32.040913 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 73/152] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:31 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:32.213310 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-eaf20c82-b172-49aa-8ed2-fd627f36e3ef tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:32.221877 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-eaf20c82-b172-49aa-8ed2-fd627f36e3ef tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1501 microversion: 2.1 time: 0.219279 May 16 18:49:32.235754 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 80/153] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:32 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1501 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:32.506719 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0631df11-af49-4487-9918-d7dd8b836d6d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:32.508530 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0631df11-af49-4487-9918-d7dd8b836d6d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:32.522594 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0631df11-af49-4487-9918-d7dd8b836d6d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:32.523814 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0631df11-af49-4487-9918-d7dd8b836d6d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:32.527110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0631df11-af49-4487-9918-d7dd8b836d6d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:32.528332 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0631df11-af49-4487-9918-d7dd8b836d6d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:32.584813 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-3ae0ac86-2a87-41ef-80aa-4b2d136b9741 req-15fd0ee1-deff-497e-b39e-96f7a3c16bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec82e115-5ca8-47de-ba42-405096ec5d98", "name": "network-vif-plugged", "status": "completed", "tag": "f4c32d27-4431-4863-bb69-09faf2b82b93"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:32.601771 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-3ae0ac86-2a87-41ef-80aa-4b2d136b9741 req-15fd0ee1-deff-497e-b39e-96f7a3c16bd5 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:32.602501 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-3ae0ac86-2a87-41ef-80aa-4b2d136b9741 req-15fd0ee1-deff-497e-b39e-96f7a3c16bd5 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:32.630885 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-3ae0ac86-2a87-41ef-80aa-4b2d136b9741 req-15fd0ee1-deff-497e-b39e-96f7a3c16bd5 service nova] Creating event network-vif-plugged:f4c32d27-4431-4863-bb69-09faf2b82b93 for instance ec82e115-5ca8-47de-ba42-405096ec5d98 on hv-cinder-75078 May 16 18:49:32.647498 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-3ae0ac86-2a87-41ef-80aa-4b2d136b9741 req-15fd0ee1-deff-497e-b39e-96f7a3c16bd5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071311 May 16 18:49:32.648875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 81/154] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:49:32.821396 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0631df11-af49-4487-9918-d7dd8b836d6d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:32.831642 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0631df11-af49-4487-9918-d7dd8b836d6d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.331899 May 16 18:49:32.834497 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 74/155] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:32 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:33.010278 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8e1131b2-719c-4c1c-89fa-00458f45d3c4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:33.011448 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8e1131b2-719c-4c1c-89fa-00458f45d3c4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:33.025207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8e1131b2-719c-4c1c-89fa-00458f45d3c4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:33.027558 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8e1131b2-719c-4c1c-89fa-00458f45d3c4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:33.029332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8e1131b2-719c-4c1c-89fa-00458f45d3c4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:33.029848 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8e1131b2-719c-4c1c-89fa-00458f45d3c4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:33.065036 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b167f636-09fe-448e-8bdb-31d3c6ca96af tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:33.066254 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b167f636-09fe-448e-8bdb-31d3c6ca96af tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:33.084882 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b167f636-09fe-448e-8bdb-31d3c6ca96af tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:33.085262 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b167f636-09fe-448e-8bdb-31d3c6ca96af tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:33.086059 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b167f636-09fe-448e-8bdb-31d3c6ca96af tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:33.086504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b167f636-09fe-448e-8bdb-31d3c6ca96af tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:33.354839 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8e1131b2-719c-4c1c-89fa-00458f45d3c4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:33.376147 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b167f636-09fe-448e-8bdb-31d3c6ca96af tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:33.384268 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8e1131b2-719c-4c1c-89fa-00458f45d3c4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:33.388680 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8e1131b2-719c-4c1c-89fa-00458f45d3c4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:33.395659 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b167f636-09fe-448e-8bdb-31d3c6ca96af tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.339840 May 16 18:49:33.396687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8e1131b2-719c-4c1c-89fa-00458f45d3c4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.389880 May 16 18:49:33.396944 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 75/156] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:33 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:33.398410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 82/157] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:33 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:49:33.862394 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9db1d034-6465-4a53-9eee-0e3d6084926f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:33.863360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9db1d034-6465-4a53-9eee-0e3d6084926f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:33.886093 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9db1d034-6465-4a53-9eee-0e3d6084926f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:33.887118 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9db1d034-6465-4a53-9eee-0e3d6084926f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:33.888773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9db1d034-6465-4a53-9eee-0e3d6084926f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:33.889782 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9db1d034-6465-4a53-9eee-0e3d6084926f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:34.168019 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5641c6b2-15c8-44ad-9343-2429f0ebc9fe tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2f34e3d-173c-4279-9a68-a6e396f75925"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:34.170217 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5641c6b2-15c8-44ad-9343-2429f0ebc9fe tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:34.181501 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5641c6b2-15c8-44ad-9343-2429f0ebc9fe tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:34.182220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5641c6b2-15c8-44ad-9343-2429f0ebc9fe tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:34.183432 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5641c6b2-15c8-44ad-9343-2429f0ebc9fe tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:34.184393 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5641c6b2-15c8-44ad-9343-2429f0ebc9fe tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:34.213253 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9db1d034-6465-4a53-9eee-0e3d6084926f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:34.226775 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9db1d034-6465-4a53-9eee-0e3d6084926f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.370909 May 16 18:49:34.227305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 76/158] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:33 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:34.421942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0debc8c0-6898-4b2c-ba31-088c81b63b99 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:34.422681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0debc8c0-6898-4b2c-ba31-088c81b63b99 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:34.431191 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0debc8c0-6898-4b2c-ba31-088c81b63b99 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:34.432811 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0debc8c0-6898-4b2c-ba31-088c81b63b99 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:34.434817 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0debc8c0-6898-4b2c-ba31-088c81b63b99 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:34.435952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0debc8c0-6898-4b2c-ba31-088c81b63b99 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:34.736650 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0debc8c0-6898-4b2c-ba31-088c81b63b99 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:34.748023 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0debc8c0-6898-4b2c-ba31-088c81b63b99 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.331063 May 16 18:49:34.751767 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 77/159] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:34 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:34.755670 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-bbfe5138-43d2-4d4b-89c1-9b3e6b4fcef3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:34.756414 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-bbfe5138-43d2-4d4b-89c1-9b3e6b4fcef3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:34.763193 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bbfe5138-43d2-4d4b-89c1-9b3e6b4fcef3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:34.764226 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bbfe5138-43d2-4d4b-89c1-9b3e6b4fcef3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:34.764711 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bbfe5138-43d2-4d4b-89c1-9b3e6b4fcef3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:34.765204 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bbfe5138-43d2-4d4b-89c1-9b3e6b4fcef3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:35.029088 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bbfe5138-43d2-4d4b-89c1-9b3e6b4fcef3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:35.039468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bbfe5138-43d2-4d4b-89c1-9b3e6b4fcef3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:35.041499 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bbfe5138-43d2-4d4b-89c1-9b3e6b4fcef3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:35.043277 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-bbfe5138-43d2-4d4b-89c1-9b3e6b4fcef3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.292832 May 16 18:49:35.044597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 78/160] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:34 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:35.262759 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-daca566e-8a05-472a-8f80-dcb7e86e2bb6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:35.264957 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-daca566e-8a05-472a-8f80-dcb7e86e2bb6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:35.291590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daca566e-8a05-472a-8f80-dcb7e86e2bb6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:35.296591 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daca566e-8a05-472a-8f80-dcb7e86e2bb6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:35.298262 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daca566e-8a05-472a-8f80-dcb7e86e2bb6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:35.300386 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daca566e-8a05-472a-8f80-dcb7e86e2bb6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:35.458191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5641c6b2-15c8-44ad-9343-2429f0ebc9fe tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "POST /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.297355 May 16 18:49:35.462495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 83/161] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:49:34 2022] POST /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6/os-volume_attachments => generated 194 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:49:35.704813 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-daca566e-8a05-472a-8f80-dcb7e86e2bb6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:35.730098 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-daca566e-8a05-472a-8f80-dcb7e86e2bb6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.472614 May 16 18:49:35.732803 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 79/162] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:35 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:35.767962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-90c13f7a-73c2-4988-8fd6-abf5a5ef0b35 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:35.768791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-90c13f7a-73c2-4988-8fd6-abf5a5ef0b35 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:35.782126 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-90c13f7a-73c2-4988-8fd6-abf5a5ef0b35 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:35.782695 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-90c13f7a-73c2-4988-8fd6-abf5a5ef0b35 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:35.783493 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-90c13f7a-73c2-4988-8fd6-abf5a5ef0b35 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:35.784300 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-90c13f7a-73c2-4988-8fd6-abf5a5ef0b35 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:36.073625 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-174443ff-0e99-457d-9971-8116995280d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:36.094745 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-174443ff-0e99-457d-9971-8116995280d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:36.118395 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-90c13f7a-73c2-4988-8fd6-abf5a5ef0b35 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:36.128230 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-90c13f7a-73c2-4988-8fd6-abf5a5ef0b35 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.365167 May 16 18:49:36.140672 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-174443ff-0e99-457d-9971-8116995280d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:36.141874 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-174443ff-0e99-457d-9971-8116995280d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:36.144674 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-174443ff-0e99-457d-9971-8116995280d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:36.146388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 84/163] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:35 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:36.147154 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-174443ff-0e99-457d-9971-8116995280d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:36.474326 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-174443ff-0e99-457d-9971-8116995280d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:36.486111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-174443ff-0e99-457d-9971-8116995280d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:36.488368 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-174443ff-0e99-457d-9971-8116995280d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:36.489959 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-174443ff-0e99-457d-9971-8116995280d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.430089 May 16 18:49:36.491204 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 80/164] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:36 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:36.757388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-32c40626-8245-46da-92e0-8894855a98c8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:36.758211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-32c40626-8245-46da-92e0-8894855a98c8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:36.764952 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32c40626-8245-46da-92e0-8894855a98c8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:36.765152 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32c40626-8245-46da-92e0-8894855a98c8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:36.766358 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32c40626-8245-46da-92e0-8894855a98c8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:36.766989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32c40626-8245-46da-92e0-8894855a98c8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:36.937687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-32c40626-8245-46da-92e0-8894855a98c8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:36.949002 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-32c40626-8245-46da-92e0-8894855a98c8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.196217 May 16 18:49:36.959014 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 85/165] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:36 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:37.016033 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-b79e10d3-a434-41ac-964c-39b1dedfa017 req-e8d7554d-d278-4a6f-ac7e-7433a13cb262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5e49a3-f392-4cd6-9856-4b5367c2d5e2", "name": "network-vif-plugged", "status": "completed", "tag": "b440849e-31ba-4612-a125-9eec9ce576a6"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:37.030076 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-b79e10d3-a434-41ac-964c-39b1dedfa017 req-e8d7554d-d278-4a6f-ac7e-7433a13cb262 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:37.031209 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-b79e10d3-a434-41ac-964c-39b1dedfa017 req-e8d7554d-d278-4a6f-ac7e-7433a13cb262 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:37.058865 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-b79e10d3-a434-41ac-964c-39b1dedfa017 req-e8d7554d-d278-4a6f-ac7e-7433a13cb262 service nova] Creating event network-vif-plugged:b440849e-31ba-4612-a125-9eec9ce576a6 for instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 on hv-cinder-75078 May 16 18:49:37.085390 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-b79e10d3-a434-41ac-964c-39b1dedfa017 req-e8d7554d-d278-4a6f-ac7e-7433a13cb262 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078358 May 16 18:49:37.087360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 81/166] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:49:37.147920 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-782d6dc3-9644-43f9-a054-a95ccf3b0cb7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:37.148586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-782d6dc3-9644-43f9-a054-a95ccf3b0cb7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:37.161239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-782d6dc3-9644-43f9-a054-a95ccf3b0cb7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:37.163111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-782d6dc3-9644-43f9-a054-a95ccf3b0cb7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:37.164912 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-782d6dc3-9644-43f9-a054-a95ccf3b0cb7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:37.167050 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-782d6dc3-9644-43f9-a054-a95ccf3b0cb7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:37.513931 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-77e734f5-d037-4aa2-b4eb-3a7f40ce82aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:37.516070 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-77e734f5-d037-4aa2-b4eb-3a7f40ce82aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:37.552190 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-77e734f5-d037-4aa2-b4eb-3a7f40ce82aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:37.555022 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-77e734f5-d037-4aa2-b4eb-3a7f40ce82aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:37.561680 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-77e734f5-d037-4aa2-b4eb-3a7f40ce82aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:37.562930 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-77e734f5-d037-4aa2-b4eb-3a7f40ce82aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:37.725100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-782d6dc3-9644-43f9-a054-a95ccf3b0cb7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:37.747431 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-782d6dc3-9644-43f9-a054-a95ccf3b0cb7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1366 microversion: 2.1 time: 0.604797 May 16 18:49:37.753284 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 86/167] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:37 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1366 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:37.919297 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-77e734f5-d037-4aa2-b4eb-3a7f40ce82aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:37.947021 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-77e734f5-d037-4aa2-b4eb-3a7f40ce82aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:37.949993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-77e734f5-d037-4aa2-b4eb-3a7f40ce82aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:37.952010 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-77e734f5-d037-4aa2-b4eb-3a7f40ce82aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.445666 May 16 18:49:37.964334 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 82/168] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:37 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:49:37.971252 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5909e411-5d1b-4515-8792-f859a36715b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:37.972241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5909e411-5d1b-4515-8792-f859a36715b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:37.993782 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5909e411-5d1b-4515-8792-f859a36715b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:37.994589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5909e411-5d1b-4515-8792-f859a36715b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:37.996013 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5909e411-5d1b-4515-8792-f859a36715b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:37.996988 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5909e411-5d1b-4515-8792-f859a36715b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:38.268911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5909e411-5d1b-4515-8792-f859a36715b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:38.283413 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5909e411-5d1b-4515-8792-f859a36715b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.318047 May 16 18:49:38.300250 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 87/169] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:37 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:38.793573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-fc702a86-5f78-4122-a666-ac6da103a09d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:38.798093 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-fc702a86-5f78-4122-a666-ac6da103a09d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:38.822712 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fc702a86-5f78-4122-a666-ac6da103a09d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:38.825907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fc702a86-5f78-4122-a666-ac6da103a09d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:38.829005 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fc702a86-5f78-4122-a666-ac6da103a09d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:38.830368 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fc702a86-5f78-4122-a666-ac6da103a09d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:38.974975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-70511c93-0b88-496d-bb46-ecfd3b7fec0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:38.975871 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-70511c93-0b88-496d-bb46-ecfd3b7fec0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:38.994131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-70511c93-0b88-496d-bb46-ecfd3b7fec0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:38.994747 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-70511c93-0b88-496d-bb46-ecfd3b7fec0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:38.995624 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-70511c93-0b88-496d-bb46-ecfd3b7fec0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:39.001660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-70511c93-0b88-496d-bb46-ecfd3b7fec0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:39.384849 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-70511c93-0b88-496d-bb46-ecfd3b7fec0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:39.395376 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-70511c93-0b88-496d-bb46-ecfd3b7fec0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:39.397156 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-70511c93-0b88-496d-bb46-ecfd3b7fec0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:39.398299 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-70511c93-0b88-496d-bb46-ecfd3b7fec0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.430444 May 16 18:49:39.411958 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fc702a86-5f78-4122-a666-ac6da103a09d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:39.412243 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 88/170] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:38 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:39.417165 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-410b2967-3771-48b9-986d-0e52f3a41736 req-c648c9d9-67f7-4c9a-ad18-89151be011cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de1432f-5419-4150-84a0-0fe456962ce9", "name": "network-vif-plugged", "status": "completed", "tag": "eeb3fe2b-d9aa-4852-85f0-2e9f90328234"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:39.425761 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-fc702a86-5f78-4122-a666-ac6da103a09d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1556 microversion: 2.1 time: 0.646264 May 16 18:49:39.440313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 83/171] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:38 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1556 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:39.454023 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5fb294e0-bb8e-4afb-b91e-4aaa56a3e9d8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:39.454690 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5fb294e0-bb8e-4afb-b91e-4aaa56a3e9d8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:39.459004 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-410b2967-3771-48b9-986d-0e52f3a41736 req-c648c9d9-67f7-4c9a-ad18-89151be011cc service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:39.459619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-410b2967-3771-48b9-986d-0e52f3a41736 req-c648c9d9-67f7-4c9a-ad18-89151be011cc service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:39.473031 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5fb294e0-bb8e-4afb-b91e-4aaa56a3e9d8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:39.473360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5fb294e0-bb8e-4afb-b91e-4aaa56a3e9d8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:39.474653 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5fb294e0-bb8e-4afb-b91e-4aaa56a3e9d8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:39.475395 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5fb294e0-bb8e-4afb-b91e-4aaa56a3e9d8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:39.508542 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-410b2967-3771-48b9-986d-0e52f3a41736 req-c648c9d9-67f7-4c9a-ad18-89151be011cc service nova] Creating event network-vif-plugged:eeb3fe2b-d9aa-4852-85f0-2e9f90328234 for instance 4de1432f-5419-4150-84a0-0fe456962ce9 on hv-cinder-75078 May 16 18:49:39.527725 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-410b2967-3771-48b9-986d-0e52f3a41736 req-c648c9d9-67f7-4c9a-ad18-89151be011cc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113801 May 16 18:49:39.529230 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 89/172] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:49:39.547185 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3f60420b-37dc-439f-b6d4-04b5ecd3a762 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:39.548871 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3f60420b-37dc-439f-b6d4-04b5ecd3a762 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:39.573693 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3f60420b-37dc-439f-b6d4-04b5ecd3a762 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:39.574786 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3f60420b-37dc-439f-b6d4-04b5ecd3a762 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:39.576790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3f60420b-37dc-439f-b6d4-04b5ecd3a762 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:39.579826 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3f60420b-37dc-439f-b6d4-04b5ecd3a762 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:39.761476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3f60420b-37dc-439f-b6d4-04b5ecd3a762 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.228121 May 16 18:49:39.762062 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 90/173] 10.222.0.72 () {58 vars in 1274 bytes} [Mon May 16 18:49:39 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:49:39.898662 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5fb294e0-bb8e-4afb-b91e-4aaa56a3e9d8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:39.914222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5fb294e0-bb8e-4afb-b91e-4aaa56a3e9d8 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1361 microversion: 2.1 time: 0.470506 May 16 18:49:39.925506 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 84/174] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:39 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1361 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:40.423673 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-03b05edb-44d8-42c4-864b-99c53510be64 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:40.424878 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-03b05edb-44d8-42c4-864b-99c53510be64 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:40.431376 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03b05edb-44d8-42c4-864b-99c53510be64 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:40.431853 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03b05edb-44d8-42c4-864b-99c53510be64 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:40.432625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03b05edb-44d8-42c4-864b-99c53510be64 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:40.433058 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03b05edb-44d8-42c4-864b-99c53510be64 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:40.710913 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-03b05edb-44d8-42c4-864b-99c53510be64 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:40.727348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-03b05edb-44d8-42c4-864b-99c53510be64 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:40.730241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-03b05edb-44d8-42c4-864b-99c53510be64 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:40.732601 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-03b05edb-44d8-42c4-864b-99c53510be64 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.313526 May 16 18:49:40.735076 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 91/175] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:40 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:49:40.943945 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5dc310c5-670f-475e-91a4-2f27f680056d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:40.945233 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5dc310c5-670f-475e-91a4-2f27f680056d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:40.951703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5dc310c5-670f-475e-91a4-2f27f680056d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:40.952275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5dc310c5-670f-475e-91a4-2f27f680056d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:40.953135 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5dc310c5-670f-475e-91a4-2f27f680056d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:40.953642 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5dc310c5-670f-475e-91a4-2f27f680056d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:41.234795 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5dc310c5-670f-475e-91a4-2f27f680056d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:41.252076 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5dc310c5-670f-475e-91a4-2f27f680056d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1547 microversion: 2.1 time: 0.320145 May 16 18:49:41.253063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 85/176] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:40 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1547 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:41.282962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-63db7529-78a7-4a51-ab49-ebf7181f11a9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:41.283849 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-63db7529-78a7-4a51-ab49-ebf7181f11a9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:41.295386 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-63db7529-78a7-4a51-ab49-ebf7181f11a9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:41.296462 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-63db7529-78a7-4a51-ab49-ebf7181f11a9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:41.298265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-63db7529-78a7-4a51-ab49-ebf7181f11a9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:41.299238 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-63db7529-78a7-4a51-ab49-ebf7181f11a9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:41.494522 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-63db7529-78a7-4a51-ab49-ebf7181f11a9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.218377 May 16 18:49:41.505331 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 92/177] 10.222.0.72 () {58 vars in 1274 bytes} [Mon May 16 18:49:41 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:49:41.753753 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b46b5b2e-1902-4a9e-b973-f6dc4d3350b7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:41.754361 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b46b5b2e-1902-4a9e-b973-f6dc4d3350b7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:41.760383 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b46b5b2e-1902-4a9e-b973-f6dc4d3350b7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:41.761054 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b46b5b2e-1902-4a9e-b973-f6dc4d3350b7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:41.762007 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b46b5b2e-1902-4a9e-b973-f6dc4d3350b7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:41.762726 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b46b5b2e-1902-4a9e-b973-f6dc4d3350b7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:42.152715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b46b5b2e-1902-4a9e-b973-f6dc4d3350b7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:42.166163 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b46b5b2e-1902-4a9e-b973-f6dc4d3350b7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:42.168377 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b46b5b2e-1902-4a9e-b973-f6dc4d3350b7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:42.169826 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b46b5b2e-1902-4a9e-b973-f6dc4d3350b7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.420150 May 16 18:49:42.190757 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 86/178] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:41 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:42.363843 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-ed2b043d-c0bf-4bd5-beab-a2d5ed7f0cdb req-bcddc38c-ecd0-4eb2-8755-001287879bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec82e115-5ca8-47de-ba42-405096ec5d98", "tag": "f4c32d27-4431-4863-bb69-09faf2b82b93"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:42.373266 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-ed2b043d-c0bf-4bd5-beab-a2d5ed7f0cdb req-bcddc38c-ecd0-4eb2-8755-001287879bde service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:42.373926 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-ed2b043d-c0bf-4bd5-beab-a2d5ed7f0cdb req-bcddc38c-ecd0-4eb2-8755-001287879bde service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:42.396601 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-ed2b043d-c0bf-4bd5-beab-a2d5ed7f0cdb req-bcddc38c-ecd0-4eb2-8755-001287879bde service nova] Creating event network-changed:f4c32d27-4431-4863-bb69-09faf2b82b93 for instance ec82e115-5ca8-47de-ba42-405096ec5d98 on hv-cinder-75078 May 16 18:49:42.405691 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-ed2b043d-c0bf-4bd5-beab-a2d5ed7f0cdb req-bcddc38c-ecd0-4eb2-8755-001287879bde service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045735 May 16 18:49:42.413968 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 93/179] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:49:43.203859 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-14ff8f6e-b4ba-4404-b070-871f2d5392f7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:43.204691 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-14ff8f6e-b4ba-4404-b070-871f2d5392f7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:43.217990 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-14ff8f6e-b4ba-4404-b070-871f2d5392f7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:43.219119 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-14ff8f6e-b4ba-4404-b070-871f2d5392f7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:43.221075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-14ff8f6e-b4ba-4404-b070-871f2d5392f7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:43.222119 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-14ff8f6e-b4ba-4404-b070-871f2d5392f7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:43.622421 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-14ff8f6e-b4ba-4404-b070-871f2d5392f7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:43.645950 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-14ff8f6e-b4ba-4404-b070-871f2d5392f7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:43.653780 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-14ff8f6e-b4ba-4404-b070-871f2d5392f7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:43.655940 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-14ff8f6e-b4ba-4404-b070-871f2d5392f7 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1407 microversion: 2.20 time: 0.459809 May 16 18:49:43.664236 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 87/180] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:43 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:44.702201 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-cfc0867a-2d5f-492a-9472-40f1b88c2142 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:44.715006 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-cfc0867a-2d5f-492a-9472-40f1b88c2142 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:44.717717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-7c1bf300-4a55-4107-a9ed-16c0a561c434 req-66a1f587-25a4-46e8-a944-8c5647d3f68c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5e49a3-f392-4cd6-9856-4b5367c2d5e2", "tag": "b440849e-31ba-4612-a125-9eec9ce576a6"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:44.729209 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-7c1bf300-4a55-4107-a9ed-16c0a561c434 req-66a1f587-25a4-46e8-a944-8c5647d3f68c service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:44.730351 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-7c1bf300-4a55-4107-a9ed-16c0a561c434 req-66a1f587-25a4-46e8-a944-8c5647d3f68c service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:44.739853 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cfc0867a-2d5f-492a-9472-40f1b88c2142 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:44.740633 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cfc0867a-2d5f-492a-9472-40f1b88c2142 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:44.742004 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cfc0867a-2d5f-492a-9472-40f1b88c2142 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:44.742762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cfc0867a-2d5f-492a-9472-40f1b88c2142 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:44.744773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-7c1bf300-4a55-4107-a9ed-16c0a561c434 req-66a1f587-25a4-46e8-a944-8c5647d3f68c service nova] Creating event network-changed:b440849e-31ba-4612-a125-9eec9ce576a6 for instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 on hv-cinder-75078 May 16 18:49:44.753232 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-7c1bf300-4a55-4107-a9ed-16c0a561c434 req-66a1f587-25a4-46e8-a944-8c5647d3f68c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040042 May 16 18:49:44.758526 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 88/181] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:49:45.026526 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cfc0867a-2d5f-492a-9472-40f1b88c2142 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:45.042907 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cfc0867a-2d5f-492a-9472-40f1b88c2142 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:45.046024 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cfc0867a-2d5f-492a-9472-40f1b88c2142 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:45.048090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-cfc0867a-2d5f-492a-9472-40f1b88c2142 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1598 microversion: 2.20 time: 0.356743 May 16 18:49:45.059419 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 94/182] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:49:44 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1598 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:49:45.090480 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d35574a8-66c2-44c4-91ed-a7c4a44ba84b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:45.091439 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d35574a8-66c2-44c4-91ed-a7c4a44ba84b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:45.103907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d35574a8-66c2-44c4-91ed-a7c4a44ba84b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:45.105193 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d35574a8-66c2-44c4-91ed-a7c4a44ba84b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:45.106804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d35574a8-66c2-44c4-91ed-a7c4a44ba84b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:45.107867 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d35574a8-66c2-44c4-91ed-a7c4a44ba84b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:45.273297 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1065656077", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:45.350523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d35574a8-66c2-44c4-91ed-a7c4a44ba84b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.269960 May 16 18:49:45.352262 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 89/183] 10.222.0.72 () {60 vars in 1315 bytes} [Mon May 16 18:49:45 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:49:45.385246 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.network.neutron [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] validate_networks() for None {{(pid=128886) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:49:45.878086 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Flavor limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:49:45.879195 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Image limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:49:45.880757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Flavor pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:49:45.880757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Image pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:49:45.881208 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:49:45.897172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:45.897967 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:45.899434 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:45.900581 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:45.938216 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Getting quotas for project 08dc3aef746542f0944976334e4120f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:49:45.947843 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Getting quotas for user 7730774a21ad488cbcd6ad9e89539fb3 and project 08dc3aef746542f0944976334e4120f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:49:45.971606 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Going to run 1 instances... {{(pid=128886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:49:45.976114 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:49:46.068615 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0906f708-b056-4aac-afa8-edc1bfce1048 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799246 May 16 18:49:46.070031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 95/184] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:49:46.087047 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8cc09d43-33fb-4420-87d0-959387581169 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:46.089416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8cc09d43-33fb-4420-87d0-959387581169 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:46.218783 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8cc09d43-33fb-4420-87d0-959387581169 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:46.231128 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8cc09d43-33fb-4420-87d0-959387581169 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1215 microversion: 2.1 time: 0.150917 May 16 18:49:46.248383 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 90/185] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:46 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:46.987179 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-a510d28b-2330-441b-b4de-99fb4f0a5afa req-6b51b2c2-0c6a-45d8-a43d-51fa9b61f666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de1432f-5419-4150-84a0-0fe456962ce9", "tag": "eeb3fe2b-d9aa-4852-85f0-2e9f90328234"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:46.998233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-a510d28b-2330-441b-b4de-99fb4f0a5afa req-6b51b2c2-0c6a-45d8-a43d-51fa9b61f666 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:46.998981 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-a510d28b-2330-441b-b4de-99fb4f0a5afa req-6b51b2c2-0c6a-45d8-a43d-51fa9b61f666 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:47.027681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-a510d28b-2330-441b-b4de-99fb4f0a5afa req-6b51b2c2-0c6a-45d8-a43d-51fa9b61f666 service nova] Creating event network-changed:eeb3fe2b-d9aa-4852-85f0-2e9f90328234 for instance 4de1432f-5419-4150-84a0-0fe456962ce9 on hv-cinder-75078 May 16 18:49:47.039512 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-a510d28b-2330-441b-b4de-99fb4f0a5afa req-6b51b2c2-0c6a-45d8-a43d-51fa9b61f666 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055847 May 16 18:49:47.040628 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 96/186] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:49:47.261757 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-30f91146-79f5-4d25-bba2-ca754e1820ad tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:47.262816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-30f91146-79f5-4d25-bba2-ca754e1820ad tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:47.274499 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-30f91146-79f5-4d25-bba2-ca754e1820ad tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:47.275290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-30f91146-79f5-4d25-bba2-ca754e1820ad tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:47.276720 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-30f91146-79f5-4d25-bba2-ca754e1820ad tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:47.277499 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-30f91146-79f5-4d25-bba2-ca754e1820ad tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:47.392948 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-30f91146-79f5-4d25-bba2-ca754e1820ad tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:47.415828 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-30f91146-79f5-4d25-bba2-ca754e1820ad tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1219 microversion: 2.1 time: 0.161172 May 16 18:49:47.416682 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 91/187] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:47 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:48.447392 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d03c8314-7658-4580-bddb-f80e55dd3237 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:48.449730 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d03c8314-7658-4580-bddb-f80e55dd3237 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:48.462876 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d03c8314-7658-4580-bddb-f80e55dd3237 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:48.464139 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d03c8314-7658-4580-bddb-f80e55dd3237 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:48.465777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d03c8314-7658-4580-bddb-f80e55dd3237 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:48.466851 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d03c8314-7658-4580-bddb-f80e55dd3237 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:48.640306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d03c8314-7658-4580-bddb-f80e55dd3237 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:48.672009 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d03c8314-7658-4580-bddb-f80e55dd3237 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1219 microversion: 2.1 time: 0.232223 May 16 18:49:48.672776 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 97/188] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:48 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1219 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:49.379886 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9a7909c4-f968-49e7-a8e1-872d937a5da8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:49.380774 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9a7909c4-f968-49e7-a8e1-872d937a5da8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:49.397187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9a7909c4-f968-49e7-a8e1-872d937a5da8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:49.397847 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9a7909c4-f968-49e7-a8e1-872d937a5da8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:49.399307 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9a7909c4-f968-49e7-a8e1-872d937a5da8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:49.399939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9a7909c4-f968-49e7-a8e1-872d937a5da8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:49.455099 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9a7909c4-f968-49e7-a8e1-872d937a5da8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:49:49.643107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9a7909c4-f968-49e7-a8e1-872d937a5da8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "DELETE /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 204 len: 0 microversion: 2.1 time: 0.268713 May 16 18:49:49.645260 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 92/189] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:49:49 2022] DELETE /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:49:49.662872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-32b976a5-262c-402f-987b-d325458b3426 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:49.664834 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-32b976a5-262c-402f-987b-d325458b3426 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:49.692424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32b976a5-262c-402f-987b-d325458b3426 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:49.693475 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32b976a5-262c-402f-987b-d325458b3426 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:49.695057 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32b976a5-262c-402f-987b-d325458b3426 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:49.696060 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-32b976a5-262c-402f-987b-d325458b3426 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:49.708405 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b1950c74-1b33-4ecd-8ff0-881cfb919787 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:49.709206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b1950c74-1b33-4ecd-8ff0-881cfb919787 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:49.738715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b1950c74-1b33-4ecd-8ff0-881cfb919787 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:49.739400 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b1950c74-1b33-4ecd-8ff0-881cfb919787 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:49.751075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b1950c74-1b33-4ecd-8ff0-881cfb919787 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:49.751918 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b1950c74-1b33-4ecd-8ff0-881cfb919787 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:49.965396 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b1950c74-1b33-4ecd-8ff0-881cfb919787 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:49.997045 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b1950c74-1b33-4ecd-8ff0-881cfb919787 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1275 microversion: 2.1 time: 0.308122 May 16 18:49:50.001400 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 93/190] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:49 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1275 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:50.030092 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-32b976a5-262c-402f-987b-d325458b3426 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:50.041578 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-32b976a5-262c-402f-987b-d325458b3426 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1553 microversion: 2.1 time: 0.386236 May 16 18:49:50.052185 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 98/191] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:49 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1553 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:51.024956 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3e58b441-a46e-49ff-a237-ea586935ac02 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:51.026068 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-3e58b441-a46e-49ff-a237-ea586935ac02 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:51.038574 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3e58b441-a46e-49ff-a237-ea586935ac02 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:51.039703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3e58b441-a46e-49ff-a237-ea586935ac02 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:51.041371 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3e58b441-a46e-49ff-a237-ea586935ac02 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:51.042342 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3e58b441-a46e-49ff-a237-ea586935ac02 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:51.072548 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2ff140a9-a448-459b-91c8-52cd32a03ff8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:51.073667 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2ff140a9-a448-459b-91c8-52cd32a03ff8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:51.084348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2ff140a9-a448-459b-91c8-52cd32a03ff8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:51.084819 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2ff140a9-a448-459b-91c8-52cd32a03ff8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:51.085739 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2ff140a9-a448-459b-91c8-52cd32a03ff8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:51.090624 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2ff140a9-a448-459b-91c8-52cd32a03ff8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:51.179322 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-3e58b441-a46e-49ff-a237-ea586935ac02 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:51.189241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3e58b441-a46e-49ff-a237-ea586935ac02 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1275 microversion: 2.1 time: 0.169890 May 16 18:49:51.190437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 94/192] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:51 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:51.327312 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2ff140a9-a448-459b-91c8-52cd32a03ff8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:51.339214 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2ff140a9-a448-459b-91c8-52cd32a03ff8 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1553 microversion: 2.1 time: 0.270895 May 16 18:49:51.340408 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 99/193] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:51 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1553 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:52.214377 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-448e04ba-7ab8-4908-977e-e8da306c216c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:52.215592 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-448e04ba-7ab8-4908-977e-e8da306c216c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:52.222682 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-448e04ba-7ab8-4908-977e-e8da306c216c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:52.223324 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-448e04ba-7ab8-4908-977e-e8da306c216c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:52.224134 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-448e04ba-7ab8-4908-977e-e8da306c216c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:52.224739 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-448e04ba-7ab8-4908-977e-e8da306c216c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:52.359574 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-26eab103-2c74-4dc6-a5e7-27996f93ce62 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:52.360989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-26eab103-2c74-4dc6-a5e7-27996f93ce62 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:52.369668 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-26eab103-2c74-4dc6-a5e7-27996f93ce62 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:52.370326 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-26eab103-2c74-4dc6-a5e7-27996f93ce62 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:52.371544 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-26eab103-2c74-4dc6-a5e7-27996f93ce62 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:52.372162 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-26eab103-2c74-4dc6-a5e7-27996f93ce62 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:52.464452 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-448e04ba-7ab8-4908-977e-e8da306c216c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:52.481462 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-448e04ba-7ab8-4908-977e-e8da306c216c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1273 microversion: 2.1 time: 0.271219 May 16 18:49:52.498085 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 95/194] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:52 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:52.708857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-26eab103-2c74-4dc6-a5e7-27996f93ce62 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:52.719735 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-26eab103-2c74-4dc6-a5e7-27996f93ce62 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1553 microversion: 2.1 time: 0.364074 May 16 18:49:52.720292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 100/195] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:52 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1553 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:53.512250 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7d9bd515-770d-4261-a95b-4e5387ee704c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:53.513582 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7d9bd515-770d-4261-a95b-4e5387ee704c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:53.521756 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7d9bd515-770d-4261-a95b-4e5387ee704c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:53.524183 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7d9bd515-770d-4261-a95b-4e5387ee704c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:53.525739 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7d9bd515-770d-4261-a95b-4e5387ee704c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:53.526395 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7d9bd515-770d-4261-a95b-4e5387ee704c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:53.659018 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7d9bd515-770d-4261-a95b-4e5387ee704c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:53.679779 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7d9bd515-770d-4261-a95b-4e5387ee704c tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1273 microversion: 2.1 time: 0.174527 May 16 18:49:53.682094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 96/196] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:53 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:53.752970 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5d520fc2-cf8e-4112-8ada-0e7727e912b3 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:53.754013 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5d520fc2-cf8e-4112-8ada-0e7727e912b3 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:53.765474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d520fc2-cf8e-4112-8ada-0e7727e912b3 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:53.765920 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d520fc2-cf8e-4112-8ada-0e7727e912b3 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:53.766971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d520fc2-cf8e-4112-8ada-0e7727e912b3 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:53.767725 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d520fc2-cf8e-4112-8ada-0e7727e912b3 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:53.937246 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5d520fc2-cf8e-4112-8ada-0e7727e912b3 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:53.955831 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5d520fc2-cf8e-4112-8ada-0e7727e912b3 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1511 microversion: 2.1 time: 0.209330 May 16 18:49:53.969281 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 101/197] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:53 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:53.971300 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-97fce8fc-9093-4d4a-84b8-51c130f61578 req-23f5badd-9fac-4636-a8c2-60b427726bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910f83ed-e7ef-4355-8027-d81af4b020c6", "name": "network-vif-deleted", "tag": "fbfdd317-119d-4147-970a-8341b34a1205"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:54.018061 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-97fce8fc-9093-4d4a-84b8-51c130f61578 req-23f5badd-9fac-4636-a8c2-60b427726bb1 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:54.019881 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-97fce8fc-9093-4d4a-84b8-51c130f61578 req-23f5badd-9fac-4636-a8c2-60b427726bb1 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:54.035555 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-97fce8fc-9093-4d4a-84b8-51c130f61578 req-23f5badd-9fac-4636-a8c2-60b427726bb1 service nova] Creating event network-vif-deleted:fbfdd317-119d-4147-970a-8341b34a1205 for instance 910f83ed-e7ef-4355-8027-d81af4b020c6 on hv-cinder-75078 May 16 18:49:54.056873 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-97fce8fc-9093-4d4a-84b8-51c130f61578 req-23f5badd-9fac-4636-a8c2-60b427726bb1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089790 May 16 18:49:54.061984 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 97/198] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:49:54.698938 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ae25a6d4-feac-445a-9074-9f4ed7036793 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:54.699621 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ae25a6d4-feac-445a-9074-9f4ed7036793 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:54.715617 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae25a6d4-feac-445a-9074-9f4ed7036793 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:54.716951 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae25a6d4-feac-445a-9074-9f4ed7036793 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:54.720521 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae25a6d4-feac-445a-9074-9f4ed7036793 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:54.722542 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae25a6d4-feac-445a-9074-9f4ed7036793 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:54.984985 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:54.986686 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:54.998189 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:54.999354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:55.001501 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:55.002512 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:55.003887 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ae25a6d4-feac-445a-9074-9f4ed7036793 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:55.015692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ae25a6d4-feac-445a-9074-9f4ed7036793 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1315 microversion: 2.1 time: 0.320512 May 16 18:49:55.032087 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 102/199] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:54 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:55.074083 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:55.075448 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:55.076524 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lazy-loading 'fault' on Instance uuid 910f83ed-e7ef-4355-8027-d81af4b020c6 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:49:55.179571 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e82aeba3f3b4304b0bb938aca6b92b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:55.215820 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8f5e6958-e63c-4119-8265-2d4193953c85 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 200 len: 1350 microversion: 2.1 time: 0.240161 May 16 18:49:55.231170 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 98/200] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:54 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 1350 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:49:56.034497 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0a015b66-c9fb-45fb-a777-10a41e943378 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:56.035532 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0a015b66-c9fb-45fb-a777-10a41e943378 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:56.042403 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a015b66-c9fb-45fb-a777-10a41e943378 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:56.042864 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a015b66-c9fb-45fb-a777-10a41e943378 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:56.043649 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a015b66-c9fb-45fb-a777-10a41e943378 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:56.044448 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a015b66-c9fb-45fb-a777-10a41e943378 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:56.085318 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-b99974db-6644-480e-b318-37995a1e540a req-5de50bf3-06b0-4aab-b13d-646db26b05f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89054f63-9774-4e06-a866-6416f970a1e0", "tag": "62cc6515-5db3-4191-98fa-965327cdfa77"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:49:56.097298 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-b99974db-6644-480e-b318-37995a1e540a req-5de50bf3-06b0-4aab-b13d-646db26b05f9 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:56.102158 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-b99974db-6644-480e-b318-37995a1e540a req-5de50bf3-06b0-4aab-b13d-646db26b05f9 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:56.120255 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-b99974db-6644-480e-b318-37995a1e540a req-5de50bf3-06b0-4aab-b13d-646db26b05f9 service nova] Creating event network-changed:62cc6515-5db3-4191-98fa-965327cdfa77 for instance 89054f63-9774-4e06-a866-6416f970a1e0 on hv-cinder-75078 May 16 18:49:56.126177 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-b99974db-6644-480e-b318-37995a1e540a req-5de50bf3-06b0-4aab-b13d-646db26b05f9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045142 May 16 18:49:56.127841 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 99/201] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:49:56.258860 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-de6a23ab-a043-49bd-9207-592186091d00 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:56.260053 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-de6a23ab-a043-49bd-9207-592186091d00 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:56.283967 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-de6a23ab-a043-49bd-9207-592186091d00 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:56.285378 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-de6a23ab-a043-49bd-9207-592186091d00 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:56.286747 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-de6a23ab-a043-49bd-9207-592186091d00 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:56.287515 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-de6a23ab-a043-49bd-9207-592186091d00 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:56.341251 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-de6a23ab-a043-49bd-9207-592186091d00 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] HTTP exception thrown: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-de6a23ab-a043-49bd-9207-592186091d00 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Request method failure captured: May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 HTTP/1.1 May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpx_0Df_izBpG0weyMKHNCd9AtHFL7TdPNMDhx5nLav2rbcD7Ndt9L7kBx2I4Q9h3SdnzYh37e1t3PZd0JDN6tG3dOh4LprHMCAYJVwVpEs7jyYu3ss1o8bTFCe6U0kLkhgNCTgqailRjz2cVX4DmRi7pB9tgFZ-hyNzZRLhZYCcmKM May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: b17a9621d46a4dec8cc4b8946abaa2c9 May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-DeleteServersTestJSON-767516164 May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:49:56.353981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-DeleteServersTestJSON-767516164 May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: b17a9621d46a4dec8cc4b8946abaa2c9 May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-DeleteServersTestJSON-767516164 May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-DeleteServersTestJSON-767516164-project May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 2e82aeba3f3b4304b0bb938aca6b92b8 May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-DeleteServersTestJSON-767516164-project May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:56.356570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '910f83ed-e7ef-4355-8027-d81af4b020c6'} May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:49:56.357884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:56.362131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:56.369168 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-de6a23ab-a043-49bd-9207-592186091d00 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Returning 404 to user: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:49:56.369168 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-de6a23ab-a043-49bd-9207-592186091d00 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 404 len: 111 microversion: 2.1 time: 0.120481 May 16 18:49:56.369168 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 100/202] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:56 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:49:56.376760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0a015b66-c9fb-45fb-a777-10a41e943378 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:56.396108 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0a015b66-c9fb-45fb-a777-10a41e943378 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1315 microversion: 2.1 time: 0.364847 May 16 18:49:56.420099 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 103/203] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:56 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:56.516295 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c54ac718-d281-4310-9edb-82515dcd5f3a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:56.517671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c54ac718-d281-4310-9edb-82515dcd5f3a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:56.529747 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c54ac718-d281-4310-9edb-82515dcd5f3a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:56.530352 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c54ac718-d281-4310-9edb-82515dcd5f3a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:56.531333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c54ac718-d281-4310-9edb-82515dcd5f3a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:56.531855 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c54ac718-d281-4310-9edb-82515dcd5f3a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:56.552757 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-c54ac718-d281-4310-9edb-82515dcd5f3a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] HTTP exception thrown: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c54ac718-d281-4310-9edb-82515dcd5f3a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Request method failure captured: May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6/os-volume_attachments HTTP/1.1 May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpx_0Df_izBpG0weyMKHNCd9AtHFL7TdPNMDhx5nLav2rbcD7Ndt9L7kBx2I4Q9h3SdnzYh37e1t3PZd0JDN6tG3dOh4LprHMCAYJVwVpEs7jyYu3ss1o8bTFCe6U0kLkhgNCTgqailRjz2cVX4DmRi7pB9tgFZ-hyNzZRLhZYCcmKM May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: b17a9621d46a4dec8cc4b8946abaa2c9 May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-DeleteServersTestJSON-767516164 May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:49:56.556235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-DeleteServersTestJSON-767516164 May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: b17a9621d46a4dec8cc4b8946abaa2c9 May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-DeleteServersTestJSON-767516164 May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-DeleteServersTestJSON-767516164-project May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 2e82aeba3f3b4304b0bb938aca6b92b8 May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-DeleteServersTestJSON-767516164-project May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:56.557725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'server_id': '910f83ed-e7ef-4355-8027-d81af4b020c6'} May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:49:56.558969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:56.560772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:56.562712 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c54ac718-d281-4310-9edb-82515dcd5f3a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Returning 404 to user: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:49:56.562712 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c54ac718-d281-4310-9edb-82515dcd5f3a tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052820 May 16 18:49:56.562712 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 101/204] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:49:56 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:49:57.429911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5014c27f-4109-435a-87c4-2e2e3551a14a tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:57.430967 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5014c27f-4109-435a-87c4-2e2e3551a14a tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:57.446337 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5014c27f-4109-435a-87c4-2e2e3551a14a tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:57.447118 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5014c27f-4109-435a-87c4-2e2e3551a14a tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:57.448696 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5014c27f-4109-435a-87c4-2e2e3551a14a tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:57.449460 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5014c27f-4109-435a-87c4-2e2e3551a14a tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:57.914851 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0d40f16e-6410-43e5-af3d-d829c5812af9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:57.916197 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0d40f16e-6410-43e5-af3d-d829c5812af9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:57.939641 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5014c27f-4109-435a-87c4-2e2e3551a14a tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:57.951100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5014c27f-4109-435a-87c4-2e2e3551a14a tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1315 microversion: 2.1 time: 0.529960 May 16 18:49:57.952620 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d40f16e-6410-43e5-af3d-d829c5812af9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:57.953692 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d40f16e-6410-43e5-af3d-d829c5812af9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:57.955419 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d40f16e-6410-43e5-af3d-d829c5812af9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:57.957276 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d40f16e-6410-43e5-af3d-d829c5812af9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:57.962575 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 104/205] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:57 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:49:57.999114 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-0d40f16e-6410-43e5-af3d-d829c5812af9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] HTTP exception thrown: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0d40f16e-6410-43e5-af3d-d829c5812af9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Request method failure captured: May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: DELETE /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 HTTP/1.1 May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpx_0Df_izBpG0weyMKHNCd9AtHFL7TdPNMDhx5nLav2rbcD7Ndt9L7kBx2I4Q9h3SdnzYh37e1t3PZd0JDN6tG3dOh4LprHMCAYJVwVpEs7jyYu3ss1o8bTFCe6U0kLkhgNCTgqailRjz2cVX4DmRi7pB9tgFZ-hyNzZRLhZYCcmKM May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: b17a9621d46a4dec8cc4b8946abaa2c9 May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-DeleteServersTestJSON-767516164 May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:49:58.000573 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-DeleteServersTestJSON-767516164 May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: b17a9621d46a4dec8cc4b8946abaa2c9 May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-DeleteServersTestJSON-767516164 May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-DeleteServersTestJSON-767516164-project May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 2e82aeba3f3b4304b0bb938aca6b92b8 May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-DeleteServersTestJSON-767516164-project May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:58.002110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '910f83ed-e7ef-4355-8027-d81af4b020c6'} May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:49:58.002877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:58.006565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:49:58.013105 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0d40f16e-6410-43e5-af3d-d829c5812af9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Returning 404 to user: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:49:58.013105 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0d40f16e-6410-43e5-af3d-d829c5812af9 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "DELETE /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 404 len: 111 microversion: 2.1 time: 0.090857 May 16 18:49:58.013105 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 102/206] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:49:57 2022] DELETE /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:49:58.027421 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-fc5dc445-a6a2-457a-a300-214e9622a8f0 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:58.028696 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-fc5dc445-a6a2-457a-a300-214e9622a8f0 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] [instance: 910f83ed-e7ef-4355-8027-d81af4b020c6] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:58.043854 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fc5dc445-a6a2-457a-a300-214e9622a8f0 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:58.049595 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fc5dc445-a6a2-457a-a300-214e9622a8f0 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:58.053012 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fc5dc445-a6a2-457a-a300-214e9622a8f0 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:58.053899 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fc5dc445-a6a2-457a-a300-214e9622a8f0 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:58.092432 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-fc5dc445-a6a2-457a-a300-214e9622a8f0 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] HTTP exception thrown: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-fc5dc445-a6a2-457a-a300-214e9622a8f0 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Request method failure captured: May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 HTTP/1.1 May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpx_0Df_izBpG0weyMKHNCd9AtHFL7TdPNMDhx5nLav2rbcD7Ndt9L7kBx2I4Q9h3SdnzYh37e1t3PZd0JDN6tG3dOh4LprHMCAYJVwVpEs7jyYu3ss1o8bTFCe6U0kLkhgNCTgqailRjz2cVX4DmRi7pB9tgFZ-hyNzZRLhZYCcmKM May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: b17a9621d46a4dec8cc4b8946abaa2c9 May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-DeleteServersTestJSON-767516164 May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:49:58.102182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b17a9621d46a4dec8cc4b8946abaa2c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-DeleteServersTestJSON-767516164 May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: b17a9621d46a4dec8cc4b8946abaa2c9 May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-DeleteServersTestJSON-767516164 May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-DeleteServersTestJSON-767516164-project May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 2e82aeba3f3b4304b0bb938aca6b92b8 May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-DeleteServersTestJSON-767516164-project May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:58.104220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '910f83ed-e7ef-4355-8027-d81af4b020c6'} May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:49:58.105352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. May 16 18:49:58.113560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:49:58.115293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-fc5dc445-a6a2-457a-a300-214e9622a8f0 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] Returning 404 to user: Instance 910f83ed-e7ef-4355-8027-d81af4b020c6 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:49:58.115293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-fc5dc445-a6a2-457a-a300-214e9622a8f0 tempest-DeleteServersTestJSON-767516164 tempest-DeleteServersTestJSON-767516164-project] 10.222.0.72 "GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6" status: 404 len: 111 microversion: 2.1 time: 0.091167 May 16 18:49:58.115293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 105/207] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:58 2022] GET /compute/v2.1/servers/910f83ed-e7ef-4355-8027-d81af4b020c6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 18:49:58.970583 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-285f6dad-75b0-480d-b1e8-46b4aff92639 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:49:58.971875 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-285f6dad-75b0-480d-b1e8-46b4aff92639 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:49:58.978315 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-285f6dad-75b0-480d-b1e8-46b4aff92639 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:58.978814 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-285f6dad-75b0-480d-b1e8-46b4aff92639 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:58.979611 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-285f6dad-75b0-480d-b1e8-46b4aff92639 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:49:58.980218 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-285f6dad-75b0-480d-b1e8-46b4aff92639 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:49:59.255959 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-285f6dad-75b0-480d-b1e8-46b4aff92639 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:49:59.273020 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-285f6dad-75b0-480d-b1e8-46b4aff92639 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1315 microversion: 2.1 time: 0.303084 May 16 18:49:59.274800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 103/208] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:49:58 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:00.290684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2e0c46d9-1979-45cf-8e07-44beeed866fe tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:00.291967 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2e0c46d9-1979-45cf-8e07-44beeed866fe tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:00.301642 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e0c46d9-1979-45cf-8e07-44beeed866fe tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:00.302440 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e0c46d9-1979-45cf-8e07-44beeed866fe tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:00.304114 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e0c46d9-1979-45cf-8e07-44beeed866fe tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:00.304706 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e0c46d9-1979-45cf-8e07-44beeed866fe tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:00.490286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2e0c46d9-1979-45cf-8e07-44beeed866fe tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:00.523975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2e0c46d9-1979-45cf-8e07-44beeed866fe tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1315 microversion: 2.1 time: 0.237508 May 16 18:50:00.524890 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 106/209] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:00 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:00.885533 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-8b476512-dbd5-4305-a8f1-e9686a48539b req-dabfab62-5357-4a23-a877-1b3cf8f55034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89054f63-9774-4e06-a866-6416f970a1e0", "name": "network-vif-plugged", "status": "completed", "tag": "62cc6515-5db3-4191-98fa-965327cdfa77"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:00.908246 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-8b476512-dbd5-4305-a8f1-e9686a48539b req-dabfab62-5357-4a23-a877-1b3cf8f55034 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:00.908921 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-8b476512-dbd5-4305-a8f1-e9686a48539b req-dabfab62-5357-4a23-a877-1b3cf8f55034 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:00.976010 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-8b476512-dbd5-4305-a8f1-e9686a48539b req-dabfab62-5357-4a23-a877-1b3cf8f55034 service nova] Creating event network-vif-plugged:62cc6515-5db3-4191-98fa-965327cdfa77 for instance 89054f63-9774-4e06-a866-6416f970a1e0 on hv-cinder-75078 May 16 18:50:00.991013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-8b476512-dbd5-4305-a8f1-e9686a48539b req-dabfab62-5357-4a23-a877-1b3cf8f55034 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111274 May 16 18:50:00.992628 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 104/210] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:50:01.552089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3b677b8d-8afa-4342-b742-f03985d69c59 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:01.553592 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3b677b8d-8afa-4342-b742-f03985d69c59 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:01.564937 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b677b8d-8afa-4342-b742-f03985d69c59 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:01.566263 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b677b8d-8afa-4342-b742-f03985d69c59 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:01.567330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b677b8d-8afa-4342-b742-f03985d69c59 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:01.568230 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b677b8d-8afa-4342-b742-f03985d69c59 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:01.851388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3b677b8d-8afa-4342-b742-f03985d69c59 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:01.880572 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3b677b8d-8afa-4342-b742-f03985d69c59 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1315 microversion: 2.1 time: 0.335442 May 16 18:50:01.881589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 107/211] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:01 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:02.903401 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ab1b9426-d71b-4449-995c-ad9bd9d0f48b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:02.904210 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ab1b9426-d71b-4449-995c-ad9bd9d0f48b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:02.920184 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ab1b9426-d71b-4449-995c-ad9bd9d0f48b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:02.921223 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ab1b9426-d71b-4449-995c-ad9bd9d0f48b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:02.929346 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ab1b9426-d71b-4449-995c-ad9bd9d0f48b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:02.937173 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ab1b9426-d71b-4449-995c-ad9bd9d0f48b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:03.262245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ab1b9426-d71b-4449-995c-ad9bd9d0f48b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:03.272778 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ab1b9426-d71b-4449-995c-ad9bd9d0f48b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1315 microversion: 2.1 time: 0.374631 May 16 18:50:03.274027 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 105/212] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:02 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:04.292084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e8bd52d5-4869-4ecf-a81f-3b81ddeb5aab tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:04.292879 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-e8bd52d5-4869-4ecf-a81f-3b81ddeb5aab tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:04.303199 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e8bd52d5-4869-4ecf-a81f-3b81ddeb5aab tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:04.304147 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e8bd52d5-4869-4ecf-a81f-3b81ddeb5aab tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:04.305224 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e8bd52d5-4869-4ecf-a81f-3b81ddeb5aab tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:04.305905 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e8bd52d5-4869-4ecf-a81f-3b81ddeb5aab tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:04.573710 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e8bd52d5-4869-4ecf-a81f-3b81ddeb5aab tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:04.598686 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e8bd52d5-4869-4ecf-a81f-3b81ddeb5aab tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1464 microversion: 2.1 time: 0.307533 May 16 18:50:04.599418 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 108/213] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:04 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1464 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:04.670620 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-fac2e11d-4fbc-44eb-aaeb-658e89a33318 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:04.670620 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-fac2e11d-4fbc-44eb-aaeb-658e89a33318 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:04.679736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fac2e11d-4fbc-44eb-aaeb-658e89a33318 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:04.680192 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fac2e11d-4fbc-44eb-aaeb-658e89a33318 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:04.680973 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fac2e11d-4fbc-44eb-aaeb-658e89a33318 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:04.681406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fac2e11d-4fbc-44eb-aaeb-658e89a33318 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:04.742328 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-fac2e11d-4fbc-44eb-aaeb-658e89a33318 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:50:04.897110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-fac2e11d-4fbc-44eb-aaeb-658e89a33318 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "DELETE /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 204 len: 0 microversion: 2.1 time: 0.230686 May 16 18:50:04.904051 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 106/214] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:50:04 2022] DELETE /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:50:04.914715 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-85ff009d-ce9b-4200-a04f-a2b6d75ae819 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:04.916410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-85ff009d-ce9b-4200-a04f-a2b6d75ae819 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:04.927893 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-85ff009d-ce9b-4200-a04f-a2b6d75ae819 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:04.929194 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-85ff009d-ce9b-4200-a04f-a2b6d75ae819 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:04.931031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-85ff009d-ce9b-4200-a04f-a2b6d75ae819 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:04.932671 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-85ff009d-ce9b-4200-a04f-a2b6d75ae819 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:05.230941 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-85ff009d-ce9b-4200-a04f-a2b6d75ae819 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:05.253908 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-85ff009d-ce9b-4200-a04f-a2b6d75ae819 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1470 microversion: 2.1 time: 0.346049 May 16 18:50:05.256001 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 109/215] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:04 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1470 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:06.290406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-fa5f6e6e-bd0f-4d51-b1b2-3eb971c9ab09 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:06.291288 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-fa5f6e6e-bd0f-4d51-b1b2-3eb971c9ab09 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:06.307756 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fa5f6e6e-bd0f-4d51-b1b2-3eb971c9ab09 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:06.308824 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fa5f6e6e-bd0f-4d51-b1b2-3eb971c9ab09 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:06.315956 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fa5f6e6e-bd0f-4d51-b1b2-3eb971c9ab09 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:06.316835 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fa5f6e6e-bd0f-4d51-b1b2-3eb971c9ab09 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:06.564866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fa5f6e6e-bd0f-4d51-b1b2-3eb971c9ab09 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:06.602025 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-fa5f6e6e-bd0f-4d51-b1b2-3eb971c9ab09 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1470 microversion: 2.1 time: 0.315423 May 16 18:50:06.603037 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 107/216] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:06 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1470 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:07.625248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-958a9d46-c46a-4d90-b972-cd7c2edd2cb5 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:07.626238 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-958a9d46-c46a-4d90-b972-cd7c2edd2cb5 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:07.643025 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-958a9d46-c46a-4d90-b972-cd7c2edd2cb5 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:07.643961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-958a9d46-c46a-4d90-b972-cd7c2edd2cb5 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:07.663655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-958a9d46-c46a-4d90-b972-cd7c2edd2cb5 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:07.664999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-958a9d46-c46a-4d90-b972-cd7c2edd2cb5 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:07.895755 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-958a9d46-c46a-4d90-b972-cd7c2edd2cb5 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:07.904005 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-958a9d46-c46a-4d90-b972-cd7c2edd2cb5 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1470 microversion: 2.1 time: 0.286929 May 16 18:50:07.904923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 110/217] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:07 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1470 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:08.620429 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-164542260", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:08.703147 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] validate_networks() for [('4df4ca2b-7e61-442b-9928-5c7e92cf8bf8', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:50:08.934051 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-06890291-71de-4f5a-9bfb-bf19b1be0866 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:08.936756 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-06890291-71de-4f5a-9bfb-bf19b1be0866 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:08.951332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-06890291-71de-4f5a-9bfb-bf19b1be0866 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:08.952377 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-06890291-71de-4f5a-9bfb-bf19b1be0866 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:08.953737 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-06890291-71de-4f5a-9bfb-bf19b1be0866 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:08.954538 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-06890291-71de-4f5a-9bfb-bf19b1be0866 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:09.187539 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-06890291-71de-4f5a-9bfb-bf19b1be0866 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:09.203070 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-06890291-71de-4f5a-9bfb-bf19b1be0866 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1470 microversion: 2.1 time: 0.277512 May 16 18:50:09.204383 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 111/218] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:08 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:09.259228 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:50:09.259649 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:50:09.260148 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:50:09.260551 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:50:09.260951 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:50:09.274347 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:09.274792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:09.275594 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:09.276037 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:09.296348 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Getting quotas for project 9fe0e3c0f5eb4d4199f084be233eb1d3. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:50:09.301313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Getting quotas for user 89539508b327427ba1a449fe30569606 and project 9fe0e3c0f5eb4d4199f084be233eb1d3. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:50:09.314643 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:50:09.317666 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:50:09.370160 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4ba76375-e876-4b6d-a3b0-f242916738c6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.885075 May 16 18:50:09.371135 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 108/219] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:50:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:50:09.384590 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c933af69-d34b-4e45-8ecf-bf7993e4100e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:09.385431 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c933af69-d34b-4e45-8ecf-bf7993e4100e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:09.452657 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c933af69-d34b-4e45-8ecf-bf7993e4100e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:09.466729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c933af69-d34b-4e45-8ecf-bf7993e4100e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1221 microversion: 2.1 time: 0.085524 May 16 18:50:09.467652 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 112/220] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:09 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:09.544762 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-868551900", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:09.625710 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] validate_networks() for [('4df4ca2b-7e61-442b-9928-5c7e92cf8bf8', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:50:10.226732 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-be96a2a8-79b6-45da-b0f8-62075471cb9b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:10.227880 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-be96a2a8-79b6-45da-b0f8-62075471cb9b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:10.240665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be96a2a8-79b6-45da-b0f8-62075471cb9b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:10.241549 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be96a2a8-79b6-45da-b0f8-62075471cb9b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:10.242915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be96a2a8-79b6-45da-b0f8-62075471cb9b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:10.243848 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be96a2a8-79b6-45da-b0f8-62075471cb9b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:10.513916 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:50:10.523459 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:50:10.525506 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:50:10.528405 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:50:10.529487 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:50:10.565749 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:10.566535 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:10.568220 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:10.568918 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:10.622993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Getting quotas for project 9fe0e3c0f5eb4d4199f084be233eb1d3. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:50:10.635232 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Getting quotas for user 89539508b327427ba1a449fe30569606 and project 9fe0e3c0f5eb4d4199f084be233eb1d3. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:50:10.668044 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:50:10.673487 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:50:10.739811 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-be96a2a8-79b6-45da-b0f8-62075471cb9b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:10.756763 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-be96a2a8-79b6-45da-b0f8-62075471cb9b tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1470 microversion: 2.1 time: 0.536101 May 16 18:50:10.766666 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 113/221] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:10 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1470 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:10.797981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2294e322-0234-4bff-a379-2e655d79b04f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.256553 May 16 18:50:10.798954 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 109/222] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:50:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:50:10.822244 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b9525216-c393-44d4-b0d1-edad16eba85c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:10.823288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b9525216-c393-44d4-b0d1-edad16eba85c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:10.982220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b9525216-c393-44d4-b0d1-edad16eba85c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:10.995510 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b9525216-c393-44d4-b0d1-edad16eba85c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1221 microversion: 2.1 time: 0.189897 May 16 18:50:11.005781 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 114/223] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:10 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1221 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:11.748427 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-6b8af697-c4ee-40b5-a6ba-3e2844b8634e req-33c47e38-939e-4abc-a05e-308c462eb69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89054f63-9774-4e06-a866-6416f970a1e0", "name": "network-vif-deleted", "tag": "62cc6515-5db3-4191-98fa-965327cdfa77"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:11.791908 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-263761eb-8f6e-4c63-90a8-1ec28030cf9f tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:11.794325 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-263761eb-8f6e-4c63-90a8-1ec28030cf9f tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:11.804596 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-6b8af697-c4ee-40b5-a6ba-3e2844b8634e req-33c47e38-939e-4abc-a05e-308c462eb69c service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:11.805057 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-6b8af697-c4ee-40b5-a6ba-3e2844b8634e req-33c47e38-939e-4abc-a05e-308c462eb69c service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:11.840105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-263761eb-8f6e-4c63-90a8-1ec28030cf9f tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:11.841479 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-263761eb-8f6e-4c63-90a8-1ec28030cf9f tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:11.842978 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-6b8af697-c4ee-40b5-a6ba-3e2844b8634e req-33c47e38-939e-4abc-a05e-308c462eb69c service nova] Creating event network-vif-deleted:62cc6515-5db3-4191-98fa-965327cdfa77 for instance 89054f63-9774-4e06-a866-6416f970a1e0 on hv-cinder-75078 May 16 18:50:11.847489 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-263761eb-8f6e-4c63-90a8-1ec28030cf9f tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:11.852477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-263761eb-8f6e-4c63-90a8-1ec28030cf9f tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:11.882080 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-6b8af697-c4ee-40b5-a6ba-3e2844b8634e req-33c47e38-939e-4abc-a05e-308c462eb69c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142605 May 16 18:50:11.891818 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 110/224] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:50:12.032823 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7fd5f57c-d4b5-49b5-844c-34fa5b74e164 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:12.039189 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7fd5f57c-d4b5-49b5-844c-34fa5b74e164 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:12.044717 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-263761eb-8f6e-4c63-90a8-1ec28030cf9f tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7730774a21ad488cbcd6ad9e89539fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dc3aef746542f0944976334e4120f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:12.067534 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7fd5f57c-d4b5-49b5-844c-34fa5b74e164 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:12.068554 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7fd5f57c-d4b5-49b5-844c-34fa5b74e164 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:12.072165 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7fd5f57c-d4b5-49b5-844c-34fa5b74e164 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:12.072165 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7fd5f57c-d4b5-49b5-844c-34fa5b74e164 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:12.105172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-263761eb-8f6e-4c63-90a8-1ec28030cf9f tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 200 len: 1300 microversion: 2.1 time: 0.332769 May 16 18:50:12.108260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 115/225] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:11 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 1300 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:12.349087 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7fd5f57c-d4b5-49b5-844c-34fa5b74e164 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:12.391564 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7fd5f57c-d4b5-49b5-844c-34fa5b74e164 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1225 microversion: 2.1 time: 0.380012 May 16 18:50:12.397129 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 111/226] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:12 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1225 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:13.141036 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2fcb5ed0-6cc5-496a-be7d-804452f057f0 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:13.142547 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2fcb5ed0-6cc5-496a-be7d-804452f057f0 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] [instance: 89054f63-9774-4e06-a866-6416f970a1e0] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:13.154977 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2fcb5ed0-6cc5-496a-be7d-804452f057f0 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:13.155827 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2fcb5ed0-6cc5-496a-be7d-804452f057f0 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:13.156845 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2fcb5ed0-6cc5-496a-be7d-804452f057f0 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:13.157366 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2fcb5ed0-6cc5-496a-be7d-804452f057f0 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:13.182412 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-2fcb5ed0-6cc5-496a-be7d-804452f057f0 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] HTTP exception thrown: Instance 89054f63-9774-4e06-a866-6416f970a1e0 could not be found. May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2fcb5ed0-6cc5-496a-be7d-804452f057f0 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Request method failure captured: May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 HTTP/1.1 May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpzF6i964tLI_xNyvxcIpq8VAEhPvKo996_VGW75gFeYqd-rGKnsqFJEtADpX5XivbBLEzGdL1bv5sEPmy0KJ9AfzibWEk4mLIYMk2-7tXI_JW0pT315jQ0a3joVPVKtrT465QW1yBCDo82LYRZtivpXTTMrG6tkSilWAnvnuZ1lH80 May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 08dc3aef746542f0944976334e4120f0 May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesNegativeTest-1470195801 May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:50:13.184452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_08dc3aef746542f0944976334e4120f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/08dc3aef746542f0944976334e4120f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/08dc3aef746542f0944976334e4120f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/08dc3aef746542f0944976334e4120f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesNegativeTest-1470195801 May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 08dc3aef746542f0944976334e4120f0 May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesNegativeTest-1470195801 May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesNegativeTest-1470195801-project May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 7730774a21ad488cbcd6ad9e89539fb3 May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesNegativeTest-1470195801-project May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance 89054f63-9774-4e06-a866-6416f970a1e0 could not be found. May 16 18:50:13.185991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '89054f63-9774-4e06-a866-6416f970a1e0'} May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89054f63-9774-4e06-a866-6416f970a1e0 could not be found. May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:50:13.186903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89054f63-9774-4e06-a866-6416f970a1e0 could not be found. May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89054f63-9774-4e06-a866-6416f970a1e0 could not be found. May 16 18:50:13.188850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:50:13.192518 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2fcb5ed0-6cc5-496a-be7d-804452f057f0 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] Returning 404 to user: Instance 89054f63-9774-4e06-a866-6416f970a1e0 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:50:13.193952 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2fcb5ed0-6cc5-496a-be7d-804452f057f0 tempest-VolumesNegativeTest-1470195801 tempest-VolumesNegativeTest-1470195801-project] 10.222.0.72 "GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0" status: 404 len: 111 microversion: 2.1 time: 0.067380 May 16 18:50:13.198210 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 116/227] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:13 2022] GET /compute/v2.1/servers/89054f63-9774-4e06-a866-6416f970a1e0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:50:13.419789 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5f546d6f-2515-4e6f-bb1e-b95ef74da96c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:13.434697 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5f546d6f-2515-4e6f-bb1e-b95ef74da96c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:13.472633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f546d6f-2515-4e6f-bb1e-b95ef74da96c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:13.474582 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f546d6f-2515-4e6f-bb1e-b95ef74da96c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:13.479514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f546d6f-2515-4e6f-bb1e-b95ef74da96c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:13.480667 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f546d6f-2515-4e6f-bb1e-b95ef74da96c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:14.150807 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5f546d6f-2515-4e6f-bb1e-b95ef74da96c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:14.167128 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5f546d6f-2515-4e6f-bb1e-b95ef74da96c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1273 microversion: 2.1 time: 0.758639 May 16 18:50:14.175734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 112/228] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:13 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1273 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:15.185395 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5de7d77f-d597-47c7-a613-f4614f86e072 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:15.186010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5de7d77f-d597-47c7-a613-f4614f86e072 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:15.202129 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5de7d77f-d597-47c7-a613-f4614f86e072 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:15.203838 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5de7d77f-d597-47c7-a613-f4614f86e072 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:15.209223 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5de7d77f-d597-47c7-a613-f4614f86e072 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:15.210193 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5de7d77f-d597-47c7-a613-f4614f86e072 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:15.413129 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5de7d77f-d597-47c7-a613-f4614f86e072 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:15.421709 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5de7d77f-d597-47c7-a613-f4614f86e072 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1279 microversion: 2.1 time: 0.240785 May 16 18:50:15.426872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 117/229] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:15 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:15.893631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-e721d738-950b-4e2f-98ac-77b776264203 req-d12884ff-8c75-455b-b41d-4054e5412ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2573d57-ebb1-4daf-8809-cdc7c0d32eac", "tag": "64e7bba5-2463-4d81-9a62-7e09cbe676f8"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:15.953553 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-e721d738-950b-4e2f-98ac-77b776264203 req-d12884ff-8c75-455b-b41d-4054e5412ae0 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:15.962693 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-e721d738-950b-4e2f-98ac-77b776264203 req-d12884ff-8c75-455b-b41d-4054e5412ae0 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:16.016900 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-e721d738-950b-4e2f-98ac-77b776264203 req-d12884ff-8c75-455b-b41d-4054e5412ae0 service nova] Creating event network-changed:64e7bba5-2463-4d81-9a62-7e09cbe676f8 for instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac on hv-cinder-75078 May 16 18:50:16.030508 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-e721d738-950b-4e2f-98ac-77b776264203 req-d12884ff-8c75-455b-b41d-4054e5412ae0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163507 May 16 18:50:16.033185 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 113/230] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:50:16.464921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-84f0ab26-e5bb-4f33-99ad-dd5b623ef620 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:16.466971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-84f0ab26-e5bb-4f33-99ad-dd5b623ef620 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:16.491619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-84f0ab26-e5bb-4f33-99ad-dd5b623ef620 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:16.495842 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-84f0ab26-e5bb-4f33-99ad-dd5b623ef620 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:16.499997 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-84f0ab26-e5bb-4f33-99ad-dd5b623ef620 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:16.501462 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-84f0ab26-e5bb-4f33-99ad-dd5b623ef620 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:16.927093 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-84f0ab26-e5bb-4f33-99ad-dd5b623ef620 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:16.945692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-84f0ab26-e5bb-4f33-99ad-dd5b623ef620 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.494186 May 16 18:50:16.954192 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 118/231] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:16 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:17.977634 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1a147780-725f-46ea-a356-88ae34079f47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:17.978626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1a147780-725f-46ea-a356-88ae34079f47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:18.022071 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1a147780-725f-46ea-a356-88ae34079f47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:18.023242 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1a147780-725f-46ea-a356-88ae34079f47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:18.024786 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1a147780-725f-46ea-a356-88ae34079f47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:18.028139 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1a147780-725f-46ea-a356-88ae34079f47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:18.255328 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-a843dfd3-857e-45e3-8b03-6631a94c43d8 req-f48cb2ce-e570-4612-a405-7a96060e2fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d16c0a7-c769-407d-ae82-8f9437fbe7f2", "tag": "0df5492d-e413-4dd6-a47e-19957da57f3f"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:18.302181 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-a843dfd3-857e-45e3-8b03-6631a94c43d8 req-f48cb2ce-e570-4612-a405-7a96060e2fcc service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:18.302626 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-a843dfd3-857e-45e3-8b03-6631a94c43d8 req-f48cb2ce-e570-4612-a405-7a96060e2fcc service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:18.329968 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-a843dfd3-857e-45e3-8b03-6631a94c43d8 req-f48cb2ce-e570-4612-a405-7a96060e2fcc service nova] Creating event network-changed:0df5492d-e413-4dd6-a47e-19957da57f3f for instance 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 on hv-cinder-75078 May 16 18:50:18.337018 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-a843dfd3-857e-45e3-8b03-6631a94c43d8 req-f48cb2ce-e570-4612-a405-7a96060e2fcc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111466 May 16 18:50:18.345757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 119/232] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 16 18:50:19.561570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1a147780-725f-46ea-a356-88ae34079f47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:19.581691 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1a147780-725f-46ea-a356-88ae34079f47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 1.612846 May 16 18:50:19.582409 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 114/233] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:17 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:20.608219 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-168c5a43-b921-4151-827a-55eb8dcd6d58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:20.609033 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-168c5a43-b921-4151-827a-55eb8dcd6d58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:20.622449 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-168c5a43-b921-4151-827a-55eb8dcd6d58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:20.624911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-168c5a43-b921-4151-827a-55eb8dcd6d58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:20.626162 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-168c5a43-b921-4151-827a-55eb8dcd6d58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:20.627004 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-168c5a43-b921-4151-827a-55eb8dcd6d58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:20.981572 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-84c815f6-ea7c-4afa-bc06-2c5bd69c3426 req-d74bb90e-6b15-40bc-bbfb-0c38d42a89a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2573d57-ebb1-4daf-8809-cdc7c0d32eac", "name": "network-vif-plugged", "status": "completed", "tag": "64e7bba5-2463-4d81-9a62-7e09cbe676f8"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:20.999425 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-84c815f6-ea7c-4afa-bc06-2c5bd69c3426 req-d74bb90e-6b15-40bc-bbfb-0c38d42a89a9 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:21.000162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-84c815f6-ea7c-4afa-bc06-2c5bd69c3426 req-d74bb90e-6b15-40bc-bbfb-0c38d42a89a9 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:21.018176 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-84c815f6-ea7c-4afa-bc06-2c5bd69c3426 req-d74bb90e-6b15-40bc-bbfb-0c38d42a89a9 service nova] Creating event network-vif-plugged:64e7bba5-2463-4d81-9a62-7e09cbe676f8 for instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac on hv-cinder-75078 May 16 18:50:21.028513 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-84c815f6-ea7c-4afa-bc06-2c5bd69c3426 req-d74bb90e-6b15-40bc-bbfb-0c38d42a89a9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050098 May 16 18:50:21.029833 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 115/234] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:50:21.078245 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-168c5a43-b921-4151-827a-55eb8dcd6d58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:21.100334 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-168c5a43-b921-4151-827a-55eb8dcd6d58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.498065 May 16 18:50:21.101117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 120/235] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:20 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:22.123626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-cabbdad4-ad30-4aa9-be89-26adaf1e68de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:22.125245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-cabbdad4-ad30-4aa9-be89-26adaf1e68de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:22.136776 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cabbdad4-ad30-4aa9-be89-26adaf1e68de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:22.137476 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cabbdad4-ad30-4aa9-be89-26adaf1e68de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:22.138846 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cabbdad4-ad30-4aa9-be89-26adaf1e68de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:22.139610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cabbdad4-ad30-4aa9-be89-26adaf1e68de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:22.319157 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-cabbdad4-ad30-4aa9-be89-26adaf1e68de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:22.328999 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-cabbdad4-ad30-4aa9-be89-26adaf1e68de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.213301 May 16 18:50:22.329765 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 116/236] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:22 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:22.573649 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1767683617", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "networks": [{"uuid": "261510c2-077b-471e-9a81-d70bdede9295"}]}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:22.641111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.network.neutron [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] validate_networks() for [('261510c2-077b-471e-9a81-d70bdede9295', None, None, None, None, None)] {{(pid=128886) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:50:23.255875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Flavor limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:50:23.256694 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Image limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:50:23.257503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Flavor pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:50:23.259809 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Image pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:50:23.259809 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:50:23.274802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:23.293482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:23.296590 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:23.297957 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:23.338173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Getting quotas for project b7c0f4a8f9e04a71a6b71e704c29437a. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:50:23.349331 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Getting quotas for user 4d2178471fe6400ea4db132f72bc334e and project b7c0f4a8f9e04a71a6b71e704c29437a. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:50:23.364784 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-601a02f4-3d88-49b9-b014-22ef581ba4d3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:23.366713 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Going to run 1 instances... {{(pid=128886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:50:23.367829 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-601a02f4-3d88-49b9-b014-22ef581ba4d3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:23.369315 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:50:23.384212 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-601a02f4-3d88-49b9-b014-22ef581ba4d3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:23.385743 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-601a02f4-3d88-49b9-b014-22ef581ba4d3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:23.388246 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-601a02f4-3d88-49b9-b014-22ef581ba4d3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:23.390001 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-601a02f4-3d88-49b9-b014-22ef581ba4d3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:23.462620 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ea3d2dd3-518f-4565-8a82-0b191a79ee1b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892423 May 16 18:50:23.467797 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 121/237] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:50:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:50:23.478382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8eddd13e-df70-4bef-b11b-0574b2ea569d tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:23.479561 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8eddd13e-df70-4bef-b11b-0574b2ea569d tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:23.583832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8eddd13e-df70-4bef-b11b-0574b2ea569d tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:23.597761 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8eddd13e-df70-4bef-b11b-0574b2ea569d tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1214 microversion: 2.1 time: 0.123633 May 16 18:50:23.600330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 122/238] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:23 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:23.687073 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-601a02f4-3d88-49b9-b014-22ef581ba4d3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:23.700197 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-601a02f4-3d88-49b9-b014-22ef581ba4d3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.350958 May 16 18:50:23.701912 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 117/239] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:23 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:24.622896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5c76969c-8192-40bd-bc81-eda8219c199e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:24.623518 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5c76969c-8192-40bd-bc81-eda8219c199e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:24.630205 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5c76969c-8192-40bd-bc81-eda8219c199e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:24.630655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5c76969c-8192-40bd-bc81-eda8219c199e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:24.631427 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5c76969c-8192-40bd-bc81-eda8219c199e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:24.632111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5c76969c-8192-40bd-bc81-eda8219c199e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:24.723634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5c76969c-8192-40bd-bc81-eda8219c199e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:24.725138 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-58776542-6a6c-4b3c-80f1-3bbc11941cef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:24.726286 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-58776542-6a6c-4b3c-80f1-3bbc11941cef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:24.732327 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5c76969c-8192-40bd-bc81-eda8219c199e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1218 microversion: 2.1 time: 0.113281 May 16 18:50:24.732957 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58776542-6a6c-4b3c-80f1-3bbc11941cef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:24.733460 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 123/240] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:24 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:24.733774 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58776542-6a6c-4b3c-80f1-3bbc11941cef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:24.734866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58776542-6a6c-4b3c-80f1-3bbc11941cef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:24.735509 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58776542-6a6c-4b3c-80f1-3bbc11941cef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:24.980130 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-58776542-6a6c-4b3c-80f1-3bbc11941cef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:24.988826 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-58776542-6a6c-4b3c-80f1-3bbc11941cef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.267327 May 16 18:50:24.989752 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 118/241] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:24 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:25.750139 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-21e374d8-c8d3-43f2-aade-449b97e1f35f tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:25.750749 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-21e374d8-c8d3-43f2-aade-449b97e1f35f tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:25.758287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-21e374d8-c8d3-43f2-aade-449b97e1f35f tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:25.758717 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-21e374d8-c8d3-43f2-aade-449b97e1f35f tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:25.759486 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-21e374d8-c8d3-43f2-aade-449b97e1f35f tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:25.760119 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-21e374d8-c8d3-43f2-aade-449b97e1f35f tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:25.854083 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-21e374d8-c8d3-43f2-aade-449b97e1f35f tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:25.865405 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-21e374d8-c8d3-43f2-aade-449b97e1f35f tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1210 microversion: 2.1 time: 0.119337 May 16 18:50:25.866220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 124/242] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:25 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:26.007736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-516749e9-e0ac-411a-91e9-3a4cb1a5bab8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:26.008484 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-516749e9-e0ac-411a-91e9-3a4cb1a5bab8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:26.015087 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-516749e9-e0ac-411a-91e9-3a4cb1a5bab8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:26.015742 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-516749e9-e0ac-411a-91e9-3a4cb1a5bab8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:26.016714 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-516749e9-e0ac-411a-91e9-3a4cb1a5bab8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:26.017154 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-516749e9-e0ac-411a-91e9-3a4cb1a5bab8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:26.263433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-516749e9-e0ac-411a-91e9-3a4cb1a5bab8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:26.274062 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-516749e9-e0ac-411a-91e9-3a4cb1a5bab8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.271762 May 16 18:50:26.275018 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 119/243] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:26 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:26.883968 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-643b4c61-e630-4398-aa69-446cff0e0ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:26.884802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-643b4c61-e630-4398-aa69-446cff0e0ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:26.892325 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-643b4c61-e630-4398-aa69-446cff0e0ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:26.893288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-643b4c61-e630-4398-aa69-446cff0e0ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:26.894441 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-643b4c61-e630-4398-aa69-446cff0e0ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:26.894893 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-643b4c61-e630-4398-aa69-446cff0e0ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:27.007363 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-643b4c61-e630-4398-aa69-446cff0e0ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:27.022232 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-643b4c61-e630-4398-aa69-446cff0e0ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1266 microversion: 2.1 time: 0.142174 May 16 18:50:27.024412 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 125/244] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:26 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:27.203407 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-a1dc3e26-1d65-4b24-a96a-13da963cf449 req-063f3a13-097d-43de-8d44-5c52149b3be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d16c0a7-c769-407d-ae82-8f9437fbe7f2", "name": "network-vif-plugged", "status": "completed", "tag": "0df5492d-e413-4dd6-a47e-19957da57f3f"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:27.225781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-a1dc3e26-1d65-4b24-a96a-13da963cf449 req-063f3a13-097d-43de-8d44-5c52149b3be4 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:27.227047 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-a1dc3e26-1d65-4b24-a96a-13da963cf449 req-063f3a13-097d-43de-8d44-5c52149b3be4 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:27.249224 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-a1dc3e26-1d65-4b24-a96a-13da963cf449 req-063f3a13-097d-43de-8d44-5c52149b3be4 service nova] Creating event network-vif-plugged:0df5492d-e413-4dd6-a47e-19957da57f3f for instance 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 on hv-cinder-75078 May 16 18:50:27.257862 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-a1dc3e26-1d65-4b24-a96a-13da963cf449 req-063f3a13-097d-43de-8d44-5c52149b3be4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060955 May 16 18:50:27.259129 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 120/245] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:50:27.294429 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-94bda4e4-eb10-4efa-a738-94c1d9e15682 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:27.295959 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-94bda4e4-eb10-4efa-a738-94c1d9e15682 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:27.318221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-94bda4e4-eb10-4efa-a738-94c1d9e15682 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:27.322527 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-94bda4e4-eb10-4efa-a738-94c1d9e15682 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:27.323788 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-94bda4e4-eb10-4efa-a738-94c1d9e15682 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:27.324684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-94bda4e4-eb10-4efa-a738-94c1d9e15682 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:27.568806 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-94bda4e4-eb10-4efa-a738-94c1d9e15682 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:27.581458 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-94bda4e4-eb10-4efa-a738-94c1d9e15682 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.291107 May 16 18:50:27.582396 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 126/246] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:27 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:28.062425 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b03cfa72-cbaf-439d-97a4-6f161a43ee94 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:28.066429 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b03cfa72-cbaf-439d-97a4-6f161a43ee94 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:28.110789 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b03cfa72-cbaf-439d-97a4-6f161a43ee94 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:28.115894 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b03cfa72-cbaf-439d-97a4-6f161a43ee94 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:28.118339 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b03cfa72-cbaf-439d-97a4-6f161a43ee94 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:28.123687 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b03cfa72-cbaf-439d-97a4-6f161a43ee94 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:28.288923 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b03cfa72-cbaf-439d-97a4-6f161a43ee94 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:28.302718 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b03cfa72-cbaf-439d-97a4-6f161a43ee94 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1284 microversion: 2.1 time: 0.258916 May 16 18:50:28.321091 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 121/247] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:28 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:28.601843 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f1fcf018-cdaa-45cc-aef0-844496f6af6e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:28.602547 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f1fcf018-cdaa-45cc-aef0-844496f6af6e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:28.609498 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f1fcf018-cdaa-45cc-aef0-844496f6af6e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:28.609946 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f1fcf018-cdaa-45cc-aef0-844496f6af6e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:28.610726 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f1fcf018-cdaa-45cc-aef0-844496f6af6e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:28.611871 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f1fcf018-cdaa-45cc-aef0-844496f6af6e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:28.788268 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f1fcf018-cdaa-45cc-aef0-844496f6af6e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:28.803767 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f1fcf018-cdaa-45cc-aef0-844496f6af6e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.205459 May 16 18:50:28.805231 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 127/248] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:28 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:29.321116 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-64f32aa3-7c2c-474c-adce-00128c2ba4fe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:29.321730 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-64f32aa3-7c2c-474c-adce-00128c2ba4fe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:29.327981 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-64f32aa3-7c2c-474c-adce-00128c2ba4fe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:29.328428 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-64f32aa3-7c2c-474c-adce-00128c2ba4fe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:29.329196 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-64f32aa3-7c2c-474c-adce-00128c2ba4fe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:29.329626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-64f32aa3-7c2c-474c-adce-00128c2ba4fe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:29.406486 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-64f32aa3-7c2c-474c-adce-00128c2ba4fe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:29.415181 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-64f32aa3-7c2c-474c-adce-00128c2ba4fe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1272 microversion: 2.1 time: 0.097822 May 16 18:50:29.415802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 122/249] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:29 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:29.828272 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a672ee4b-3f10-4159-b7f0-486037100601 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:29.832370 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a672ee4b-3f10-4159-b7f0-486037100601 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:29.847991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a672ee4b-3f10-4159-b7f0-486037100601 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:29.848710 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a672ee4b-3f10-4159-b7f0-486037100601 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:29.849634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a672ee4b-3f10-4159-b7f0-486037100601 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:29.850173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a672ee4b-3f10-4159-b7f0-486037100601 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:30.170558 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a672ee4b-3f10-4159-b7f0-486037100601 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:30.193386 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a672ee4b-3f10-4159-b7f0-486037100601 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.371522 May 16 18:50:30.194437 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 128/250] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:29 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:30.431823 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6ba342aa-c72b-4c99-9226-11d139829a70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:30.433109 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6ba342aa-c72b-4c99-9226-11d139829a70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:30.439644 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ba342aa-c72b-4c99-9226-11d139829a70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:30.440273 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ba342aa-c72b-4c99-9226-11d139829a70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:30.441299 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ba342aa-c72b-4c99-9226-11d139829a70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:30.441813 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ba342aa-c72b-4c99-9226-11d139829a70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:30.527173 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6ba342aa-c72b-4c99-9226-11d139829a70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:30.540924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6ba342aa-c72b-4c99-9226-11d139829a70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1272 microversion: 2.1 time: 0.113024 May 16 18:50:30.542267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 123/251] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:30 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:31.214643 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f162f085-c249-4ee3-b348-268b4254c9a9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:31.215415 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f162f085-c249-4ee3-b348-268b4254c9a9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:31.227451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f162f085-c249-4ee3-b348-268b4254c9a9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:31.228100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f162f085-c249-4ee3-b348-268b4254c9a9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:31.229006 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f162f085-c249-4ee3-b348-268b4254c9a9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:31.229550 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f162f085-c249-4ee3-b348-268b4254c9a9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:31.562410 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d1a2d705-15c4-4f0f-8eb3-2e23c63f010e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:31.566121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d1a2d705-15c4-4f0f-8eb3-2e23c63f010e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:31.584599 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1a2d705-15c4-4f0f-8eb3-2e23c63f010e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:31.586010 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1a2d705-15c4-4f0f-8eb3-2e23c63f010e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:31.587219 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1a2d705-15c4-4f0f-8eb3-2e23c63f010e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:31.587777 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1a2d705-15c4-4f0f-8eb3-2e23c63f010e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:31.590474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f162f085-c249-4ee3-b348-268b4254c9a9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:31.611917 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f162f085-c249-4ee3-b348-268b4254c9a9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.400252 May 16 18:50:31.614425 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 129/252] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:31 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:31.974492 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d1a2d705-15c4-4f0f-8eb3-2e23c63f010e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:31.986941 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d1a2d705-15c4-4f0f-8eb3-2e23c63f010e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1272 microversion: 2.1 time: 0.429449 May 16 18:50:31.988287 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 124/253] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:31 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1272 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:32.648595 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1202721f-5044-4333-bacc-6141c46d89b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:32.650242 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1202721f-5044-4333-bacc-6141c46d89b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:32.669719 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1202721f-5044-4333-bacc-6141c46d89b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:32.670866 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1202721f-5044-4333-bacc-6141c46d89b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:32.672227 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1202721f-5044-4333-bacc-6141c46d89b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:32.672917 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1202721f-5044-4333-bacc-6141c46d89b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:33.013255 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d3e35ae0-59fa-4030-bcf9-c7ef5dc0bd70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:33.014017 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d3e35ae0-59fa-4030-bcf9-c7ef5dc0bd70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:33.026320 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3e35ae0-59fa-4030-bcf9-c7ef5dc0bd70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:33.026781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3e35ae0-59fa-4030-bcf9-c7ef5dc0bd70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:33.027980 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3e35ae0-59fa-4030-bcf9-c7ef5dc0bd70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:33.028431 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3e35ae0-59fa-4030-bcf9-c7ef5dc0bd70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:33.313856 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1202721f-5044-4333-bacc-6141c46d89b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:33.333723 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1202721f-5044-4333-bacc-6141c46d89b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1321 microversion: 2.1 time: 0.702258 May 16 18:50:33.340170 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 130/254] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:32 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1321 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:33.409648 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d3e35ae0-59fa-4030-bcf9-c7ef5dc0bd70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:33.431441 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d3e35ae0-59fa-4030-bcf9-c7ef5dc0bd70 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 0.422054 May 16 18:50:33.432480 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 125/255] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:33 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:34.369680 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1b6669ac-ba1f-47c2-b1e2-b2c9cdf8c6a8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:34.376338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1b6669ac-ba1f-47c2-b1e2-b2c9cdf8c6a8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:34.398744 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1b6669ac-ba1f-47c2-b1e2-b2c9cdf8c6a8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:34.399315 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1b6669ac-ba1f-47c2-b1e2-b2c9cdf8c6a8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:34.400724 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1b6669ac-ba1f-47c2-b1e2-b2c9cdf8c6a8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:34.401316 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1b6669ac-ba1f-47c2-b1e2-b2c9cdf8c6a8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:34.467944 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-851a0af1-d196-4c6b-a9e8-301bd9d8d536 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:34.469976 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-851a0af1-d196-4c6b-a9e8-301bd9d8d536 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:34.489451 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-851a0af1-d196-4c6b-a9e8-301bd9d8d536 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:34.489982 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-851a0af1-d196-4c6b-a9e8-301bd9d8d536 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:34.493420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-851a0af1-d196-4c6b-a9e8-301bd9d8d536 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:34.494285 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-851a0af1-d196-4c6b-a9e8-301bd9d8d536 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:35.680358 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1b6669ac-ba1f-47c2-b1e2-b2c9cdf8c6a8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:35.728698 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1b6669ac-ba1f-47c2-b1e2-b2c9cdf8c6a8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1514 microversion: 2.1 time: 1.371173 May 16 18:50:35.738366 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 131/256] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:34 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1514 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:35.760630 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-0655f526-d724-409a-99a3-08060252cdf4 req-ea5b61e2-ff6a-4d14-b0d5-7981b110ddb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0bc9562-bdde-4c63-bd12-1e1972450781", "tag": "700928d9-2f69-43d2-b6fe-da81609fa04d"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:35.762706 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-851a0af1-d196-4c6b-a9e8-301bd9d8d536 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:35.788290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-851a0af1-d196-4c6b-a9e8-301bd9d8d536 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 1.328965 May 16 18:50:35.799683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 126/257] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:34 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:35.805506 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0d98ac1b-cc9c-442e-9614-e68a1a85cd64 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:35.806430 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0d98ac1b-cc9c-442e-9614-e68a1a85cd64 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:35.821269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-0655f526-d724-409a-99a3-08060252cdf4 req-ea5b61e2-ff6a-4d14-b0d5-7981b110ddb1 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:35.823255 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-0655f526-d724-409a-99a3-08060252cdf4 req-ea5b61e2-ff6a-4d14-b0d5-7981b110ddb1 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:35.850978 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d98ac1b-cc9c-442e-9614-e68a1a85cd64 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:35.853585 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d98ac1b-cc9c-442e-9614-e68a1a85cd64 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:35.854711 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d98ac1b-cc9c-442e-9614-e68a1a85cd64 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:35.855163 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d98ac1b-cc9c-442e-9614-e68a1a85cd64 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:35.904538 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-0655f526-d724-409a-99a3-08060252cdf4 req-ea5b61e2-ff6a-4d14-b0d5-7981b110ddb1 service nova] Creating event network-changed:700928d9-2f69-43d2-b6fe-da81609fa04d for instance a0bc9562-bdde-4c63-bd12-1e1972450781 on hv-cinder-75078 May 16 18:50:35.943054 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-0d98ac1b-cc9c-442e-9614-e68a1a85cd64 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lazy-loading 'flavor' on Instance uuid 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:50:35.959014 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-0655f526-d724-409a-99a3-08060252cdf4 req-ea5b61e2-ff6a-4d14-b0d5-7981b110ddb1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216064 May 16 18:50:35.969413 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 132/258] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:50:36.706898 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0d98ac1b-cc9c-442e-9614-e68a1a85cd64 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2/action" status: 200 len: 32 microversion: 2.1 time: 0.900071 May 16 18:50:36.708390 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 127/259] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:50:35 2022] POST /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2/action => generated 32 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 18:50:36.721719 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f0a5d5d5-b4f2-4d7c-9c0d-d61a514d8394 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:36.723251 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f0a5d5d5-b4f2-4d7c-9c0d-d61a514d8394 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:36.749860 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f0a5d5d5-b4f2-4d7c-9c0d-d61a514d8394 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:36.750736 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f0a5d5d5-b4f2-4d7c-9c0d-d61a514d8394 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:36.756968 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f0a5d5d5-b4f2-4d7c-9c0d-d61a514d8394 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:36.757855 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f0a5d5d5-b4f2-4d7c-9c0d-d61a514d8394 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:36.812389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e9e11e7a-cc64-4abf-98ab-3381988a797c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:36.813669 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e9e11e7a-cc64-4abf-98ab-3381988a797c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:36.822698 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e9e11e7a-cc64-4abf-98ab-3381988a797c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:36.823435 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e9e11e7a-cc64-4abf-98ab-3381988a797c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:36.824436 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e9e11e7a-cc64-4abf-98ab-3381988a797c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:36.825028 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e9e11e7a-cc64-4abf-98ab-3381988a797c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:37.168979 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f0a5d5d5-b4f2-4d7c-9c0d-d61a514d8394 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:37.210968 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f0a5d5d5-b4f2-4d7c-9c0d-d61a514d8394 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.494863 May 16 18:50:37.212008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 133/260] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:36 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:37.285081 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e9e11e7a-cc64-4abf-98ab-3381988a797c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:37.294960 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e9e11e7a-cc64-4abf-98ab-3381988a797c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 0.490860 May 16 18:50:37.296347 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 128/261] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:36 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:37.689410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f0832e12-896f-4599-871e-fee8f30a809f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Action: 'create', calling method: .version_select at 0x7f6468068d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1844395528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcIDeK+Ng67oOjiRP9arye7tT1fsNVR61UgImuFUbqBASBmtpik+jrLOvgciQEA2gOIqNO6nU8/Nh2jqPq5ukV20nCPSzsZstJhDdmddUG3zSHA7jXWur/v5hCSLk+Epg=="}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:37.732531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-f0832e12-896f-4599-871e-fee8f30a809f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Getting quotas for project 405413536bdb433fbb7d03c8ccd34283. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:50:37.740166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-f0832e12-896f-4599-871e-fee8f30a809f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Getting quotas for user 258580b81cf0480d9728500884442b55 and project 405413536bdb433fbb7d03c8ccd34283. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:50:37.786414 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f0832e12-896f-4599-871e-fee8f30a809f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.415450 May 16 18:50:37.787416 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 134/262] 10.222.0.72 () {60 vars in 1158 bytes} [Mon May 16 18:50:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:50:38.230309 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-13d7202f-ae4d-4272-814a-64c3dda68b96 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:38.231393 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-13d7202f-ae4d-4272-814a-64c3dda68b96 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:38.237988 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-13d7202f-ae4d-4272-814a-64c3dda68b96 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:38.238799 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-13d7202f-ae4d-4272-814a-64c3dda68b96 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:38.240039 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-13d7202f-ae4d-4272-814a-64c3dda68b96 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:38.240608 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-13d7202f-ae4d-4272-814a-64c3dda68b96 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:38.333334 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9a312c78-aeeb-485e-b9dd-15320afff669 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:38.335915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9a312c78-aeeb-485e-b9dd-15320afff669 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:38.350130 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9a312c78-aeeb-485e-b9dd-15320afff669 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:38.350898 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9a312c78-aeeb-485e-b9dd-15320afff669 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:38.352318 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9a312c78-aeeb-485e-b9dd-15320afff669 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:38.353346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9a312c78-aeeb-485e-b9dd-15320afff669 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:38.501877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-13d7202f-ae4d-4272-814a-64c3dda68b96 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:38.511103 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-13d7202f-ae4d-4272-814a-64c3dda68b96 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.285462 May 16 18:50:38.512013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 129/263] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:38 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:38.564478 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9a312c78-aeeb-485e-b9dd-15320afff669 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:38.577015 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9a312c78-aeeb-485e-b9dd-15320afff669 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 0.266703 May 16 18:50:38.578184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 135/264] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:38 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:39.531065 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2c93603e-3363-4574-86f2-1f4923643360 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:39.531680 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2c93603e-3363-4574-86f2-1f4923643360 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:39.542436 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c93603e-3363-4574-86f2-1f4923643360 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:39.543157 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c93603e-3363-4574-86f2-1f4923643360 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:39.544487 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c93603e-3363-4574-86f2-1f4923643360 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:39.545302 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c93603e-3363-4574-86f2-1f4923643360 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:39.610207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-67df8875-415f-456c-b10a-78581a0e8ea3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:39.612338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-67df8875-415f-456c-b10a-78581a0e8ea3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:39.635338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-67df8875-415f-456c-b10a-78581a0e8ea3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:39.636097 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-67df8875-415f-456c-b10a-78581a0e8ea3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:39.637598 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-67df8875-415f-456c-b10a-78581a0e8ea3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:39.638678 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-67df8875-415f-456c-b10a-78581a0e8ea3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:39.889384 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2c93603e-3363-4574-86f2-1f4923643360 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:39.903185 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2c93603e-3363-4574-86f2-1f4923643360 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.376315 May 16 18:50:39.904435 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 130/265] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:39 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:39.927516 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-67df8875-415f-456c-b10a-78581a0e8ea3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:39.941329 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-67df8875-415f-456c-b10a-78581a0e8ea3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 0.345766 May 16 18:50:39.942799 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 136/266] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:39 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:40.937690 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-625747b7-172d-4b18-a90f-f8d3f41fdf82 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:40.940157 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-625747b7-172d-4b18-a90f-f8d3f41fdf82 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:40.963778 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-499e924c-340e-4bbe-89d1-baeb4fbb3dbe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:40.968715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-625747b7-172d-4b18-a90f-f8d3f41fdf82 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:40.969499 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-625747b7-172d-4b18-a90f-f8d3f41fdf82 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:40.971142 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-625747b7-172d-4b18-a90f-f8d3f41fdf82 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:40.972966 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-499e924c-340e-4bbe-89d1-baeb4fbb3dbe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:40.988625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-499e924c-340e-4bbe-89d1-baeb4fbb3dbe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:40.989120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-499e924c-340e-4bbe-89d1-baeb4fbb3dbe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:40.990048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-499e924c-340e-4bbe-89d1-baeb4fbb3dbe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:40.990549 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-499e924c-340e-4bbe-89d1-baeb4fbb3dbe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:40.991867 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-625747b7-172d-4b18-a90f-f8d3f41fdf82 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:41.321485 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-499e924c-340e-4bbe-89d1-baeb4fbb3dbe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:41.329303 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-499e924c-340e-4bbe-89d1-baeb4fbb3dbe tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 0.372603 May 16 18:50:41.335226 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 137/267] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:40 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:41.348338 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-625747b7-172d-4b18-a90f-f8d3f41fdf82 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:41.356686 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-625747b7-172d-4b18-a90f-f8d3f41fdf82 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.430308 May 16 18:50:41.357366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 131/268] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:40 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:42.357385 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f151b317-60c0-46a7-ab0b-b81592c10ea2 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:42.358536 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f151b317-60c0-46a7-ab0b-b81592c10ea2 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:42.376103 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f151b317-60c0-46a7-ab0b-b81592c10ea2 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:42.377123 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f151b317-60c0-46a7-ab0b-b81592c10ea2 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:42.378119 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9fcba293-b97f-4d73-82d0-0c03ba5b7c54 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:42.378854 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f151b317-60c0-46a7-ab0b-b81592c10ea2 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:42.379418 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9fcba293-b97f-4d73-82d0-0c03ba5b7c54 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:42.379798 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f151b317-60c0-46a7-ab0b-b81592c10ea2 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:42.394384 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9fcba293-b97f-4d73-82d0-0c03ba5b7c54 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:42.396465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9fcba293-b97f-4d73-82d0-0c03ba5b7c54 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:42.397378 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9fcba293-b97f-4d73-82d0-0c03ba5b7c54 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:42.399492 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9fcba293-b97f-4d73-82d0-0c03ba5b7c54 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:42.947084 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9fcba293-b97f-4d73-82d0-0c03ba5b7c54 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:42.955373 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9fcba293-b97f-4d73-82d0-0c03ba5b7c54 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.581850 May 16 18:50:42.956322 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 132/269] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:42 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:42.968714 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f151b317-60c0-46a7-ab0b-b81592c10ea2 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:42.985483 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f151b317-60c0-46a7-ab0b-b81592c10ea2 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 0.635561 May 16 18:50:42.986646 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 138/270] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:42 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:43.981134 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ccb81f3f-1866-4a82-8277-88b630127ffe tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:43.981947 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ccb81f3f-1866-4a82-8277-88b630127ffe tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:43.990013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ccb81f3f-1866-4a82-8277-88b630127ffe tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:43.990470 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ccb81f3f-1866-4a82-8277-88b630127ffe tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:43.991257 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ccb81f3f-1866-4a82-8277-88b630127ffe tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:43.991692 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ccb81f3f-1866-4a82-8277-88b630127ffe tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:44.037189 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-06c06c1d-794b-455d-8fad-c8eb88780a5c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:44.050313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-06c06c1d-794b-455d-8fad-c8eb88780a5c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:44.067964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-06c06c1d-794b-455d-8fad-c8eb88780a5c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:44.069138 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-06c06c1d-794b-455d-8fad-c8eb88780a5c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:44.071571 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-06c06c1d-794b-455d-8fad-c8eb88780a5c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:44.072885 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-06c06c1d-794b-455d-8fad-c8eb88780a5c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:44.297689 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ccb81f3f-1866-4a82-8277-88b630127ffe tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:44.302171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-06c06c1d-794b-455d-8fad-c8eb88780a5c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:44.309409 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ccb81f3f-1866-4a82-8277-88b630127ffe tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.335067 May 16 18:50:44.310847 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 133/271] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:43 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:44.323951 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-06c06c1d-794b-455d-8fad-c8eb88780a5c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 0.308477 May 16 18:50:44.324397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 139/272] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:43 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:45.334988 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-607fe997-ac4c-4cb9-b9a4-d7fb7e9c0c63 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:45.336052 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-607fe997-ac4c-4cb9-b9a4-d7fb7e9c0c63 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:45.340703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-43557a7f-9909-46d7-b079-5d32ec1e1633 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:45.341597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-43557a7f-9909-46d7-b079-5d32ec1e1633 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:45.347481 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-607fe997-ac4c-4cb9-b9a4-d7fb7e9c0c63 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:45.348237 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-607fe997-ac4c-4cb9-b9a4-d7fb7e9c0c63 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:45.349540 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-607fe997-ac4c-4cb9-b9a4-d7fb7e9c0c63 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:45.350287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-607fe997-ac4c-4cb9-b9a4-d7fb7e9c0c63 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:45.351655 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43557a7f-9909-46d7-b079-5d32ec1e1633 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:45.352427 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43557a7f-9909-46d7-b079-5d32ec1e1633 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:45.353707 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43557a7f-9909-46d7-b079-5d32ec1e1633 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:45.354417 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43557a7f-9909-46d7-b079-5d32ec1e1633 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:45.630947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-607fe997-ac4c-4cb9-b9a4-d7fb7e9c0c63 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:45.643908 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-43557a7f-9909-46d7-b079-5d32ec1e1633 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:45.646764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-607fe997-ac4c-4cb9-b9a4-d7fb7e9c0c63 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 0.318304 May 16 18:50:45.648266 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 140/273] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:45 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:45.653395 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-43557a7f-9909-46d7-b079-5d32ec1e1633 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.319521 May 16 18:50:45.653973 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 134/274] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:45 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:46.250202 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-f7392929-4522-42cf-a45f-7c7ae2efeb68 req-02e8a6e9-1e99-4457-b901-466485b3c706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0bc9562-bdde-4c63-bd12-1e1972450781", "name": "network-vif-plugged", "status": "completed", "tag": "700928d9-2f69-43d2-b6fe-da81609fa04d"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:46.269281 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-f7392929-4522-42cf-a45f-7c7ae2efeb68 req-02e8a6e9-1e99-4457-b901-466485b3c706 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:46.269733 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-f7392929-4522-42cf-a45f-7c7ae2efeb68 req-02e8a6e9-1e99-4457-b901-466485b3c706 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:46.294838 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-f7392929-4522-42cf-a45f-7c7ae2efeb68 req-02e8a6e9-1e99-4457-b901-466485b3c706 service nova] Creating event network-vif-plugged:700928d9-2f69-43d2-b6fe-da81609fa04d for instance a0bc9562-bdde-4c63-bd12-1e1972450781 on hv-cinder-75078 May 16 18:50:46.303093 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-f7392929-4522-42cf-a45f-7c7ae2efeb68 req-02e8a6e9-1e99-4457-b901-466485b3c706 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058808 May 16 18:50:46.304591 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 141/275] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:50:46.664838 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-58549e53-f73c-4541-8bc5-1d78278e9f30 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:46.667131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-58549e53-f73c-4541-8bc5-1d78278e9f30 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:46.674383 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58549e53-f73c-4541-8bc5-1d78278e9f30 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:46.675002 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58549e53-f73c-4541-8bc5-1d78278e9f30 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:46.676011 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58549e53-f73c-4541-8bc5-1d78278e9f30 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:46.676766 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58549e53-f73c-4541-8bc5-1d78278e9f30 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:46.677151 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-03baef6c-b063-477e-9d55-a91b1fff357b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:46.678348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-03baef6c-b063-477e-9d55-a91b1fff357b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:46.689007 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03baef6c-b063-477e-9d55-a91b1fff357b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:46.689745 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03baef6c-b063-477e-9d55-a91b1fff357b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:46.691016 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03baef6c-b063-477e-9d55-a91b1fff357b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:46.691791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03baef6c-b063-477e-9d55-a91b1fff357b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:46.952108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-58549e53-f73c-4541-8bc5-1d78278e9f30 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:46.961990 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-58549e53-f73c-4541-8bc5-1d78278e9f30 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 0.301230 May 16 18:50:46.973516 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 135/276] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:46 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:46.980886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-03baef6c-b063-477e-9d55-a91b1fff357b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:46.993767 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-03baef6c-b063-477e-9d55-a91b1fff357b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.324945 May 16 18:50:46.994807 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 142/277] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:46 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:47.488204 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-07abc4f8-65c3-48e9-8256-4b590094ae66 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:47.490799 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-07abc4f8-65c3-48e9-8256-4b590094ae66 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:47.504835 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-07abc4f8-65c3-48e9-8256-4b590094ae66 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:47.505448 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-07abc4f8-65c3-48e9-8256-4b590094ae66 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:47.506476 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-07abc4f8-65c3-48e9-8256-4b590094ae66 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:47.507158 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-07abc4f8-65c3-48e9-8256-4b590094ae66 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:47.545839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-07abc4f8-65c3-48e9-8256-4b590094ae66 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/ips" status: 200 len: 149 microversion: 2.1 time: 0.071134 May 16 18:50:47.546827 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 136/278] 10.222.0.72 () {58 vars in 1247 bytes} [Mon May 16 18:50:47 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/ips => generated 149 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:50:47.985260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8bb4a656-5b33-44b6-ae5e-43e47f50ab45 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:47.987927 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8bb4a656-5b33-44b6-ae5e-43e47f50ab45 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:47.999692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8bb4a656-5b33-44b6-ae5e-43e47f50ab45 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:48.000510 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8bb4a656-5b33-44b6-ae5e-43e47f50ab45 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:48.002647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8bb4a656-5b33-44b6-ae5e-43e47f50ab45 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:48.003343 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8bb4a656-5b33-44b6-ae5e-43e47f50ab45 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:48.019838 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-783d1b37-a72c-4ac5-89c6-7a1559358a5b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:48.020671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-783d1b37-a72c-4ac5-89c6-7a1559358a5b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:48.027197 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-783d1b37-a72c-4ac5-89c6-7a1559358a5b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:48.028110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-783d1b37-a72c-4ac5-89c6-7a1559358a5b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:48.029159 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-783d1b37-a72c-4ac5-89c6-7a1559358a5b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:48.029693 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-783d1b37-a72c-4ac5-89c6-7a1559358a5b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:48.289590 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8bb4a656-5b33-44b6-ae5e-43e47f50ab45 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:48.302237 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-783d1b37-a72c-4ac5-89c6-7a1559358a5b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:48.310883 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8bb4a656-5b33-44b6-ae5e-43e47f50ab45 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1314 microversion: 2.1 time: 0.333058 May 16 18:50:48.311466 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 143/279] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:47 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:48.311944 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-783d1b37-a72c-4ac5-89c6-7a1559358a5b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.297054 May 16 18:50:48.312537 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 137/280] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:48 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:49.107572 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e521265f-d353-49d0-b385-b2006fa7de27 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "599ec1c1-d7d6-45f6-a1ec-e8a174763d12"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:49.110683 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-e521265f-d353-49d0-b385-b2006fa7de27 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:49.120708 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e521265f-d353-49d0-b385-b2006fa7de27 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:49.121244 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e521265f-d353-49d0-b385-b2006fa7de27 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:49.122092 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e521265f-d353-49d0-b385-b2006fa7de27 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:49.122653 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e521265f-d353-49d0-b385-b2006fa7de27 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:49.334625 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5940a630-66c5-44c6-9794-c09f21b77da5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:49.335488 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5940a630-66c5-44c6-9794-c09f21b77da5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:49.343924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5940a630-66c5-44c6-9794-c09f21b77da5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:49.344517 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5940a630-66c5-44c6-9794-c09f21b77da5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:49.346131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5940a630-66c5-44c6-9794-c09f21b77da5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:49.346704 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5940a630-66c5-44c6-9794-c09f21b77da5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:49.545749 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5940a630-66c5-44c6-9794-c09f21b77da5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:49.555647 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5940a630-66c5-44c6-9794-c09f21b77da5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.227751 May 16 18:50:49.556596 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 138/281] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:49 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:49.565715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-15341475-29c8-4d8f-abd0-e34649db6b07 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:49.566627 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-15341475-29c8-4d8f-abd0-e34649db6b07 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:49.573186 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-15341475-29c8-4d8f-abd0-e34649db6b07 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:49.573627 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-15341475-29c8-4d8f-abd0-e34649db6b07 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:49.574419 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-15341475-29c8-4d8f-abd0-e34649db6b07 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:49.574908 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-15341475-29c8-4d8f-abd0-e34649db6b07 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:49.703117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e521265f-d353-49d0-b385-b2006fa7de27 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.604145 May 16 18:50:49.704749 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 144/282] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:50:49 2022] POST /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:50:49.806404 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-15341475-29c8-4d8f-abd0-e34649db6b07 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:49.820881 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-15341475-29c8-4d8f-abd0-e34649db6b07 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1497 microversion: 2.1 time: 0.260738 May 16 18:50:49.821927 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 139/283] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:49 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1497 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:50.577839 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-975eb637-08f0-478b-8d07-81b881850753 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:50.578745 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-975eb637-08f0-478b-8d07-81b881850753 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:50.586432 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-975eb637-08f0-478b-8d07-81b881850753 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:50.587006 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-975eb637-08f0-478b-8d07-81b881850753 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:50.587885 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-975eb637-08f0-478b-8d07-81b881850753 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:50.588615 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-975eb637-08f0-478b-8d07-81b881850753 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:50.746548 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-975eb637-08f0-478b-8d07-81b881850753 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:50.755188 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-975eb637-08f0-478b-8d07-81b881850753 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.185646 May 16 18:50:50.755912 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 145/284] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:50 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:50.924379 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-960585ef-9e11-4db3-93a0-4150d6312ff2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:50.925253 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-960585ef-9e11-4db3-93a0-4150d6312ff2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:50.931848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-960585ef-9e11-4db3-93a0-4150d6312ff2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:50.932303 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-960585ef-9e11-4db3-93a0-4150d6312ff2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:50.933082 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-960585ef-9e11-4db3-93a0-4150d6312ff2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:50.933516 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-960585ef-9e11-4db3-93a0-4150d6312ff2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:50.959062 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-960585ef-9e11-4db3-93a0-4150d6312ff2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/ips" status: 200 len: 145 microversion: 2.1 time: 0.039057 May 16 18:50:50.959655 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 140/285] 10.222.0.72 () {58 vars in 1247 bytes} [Mon May 16 18:50:50 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:50:51.773675 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-18beb7d3-7a4a-4a79-8f1b-2bd7d544b562 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:51.774225 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-18beb7d3-7a4a-4a79-8f1b-2bd7d544b562 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:51.781025 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-18beb7d3-7a4a-4a79-8f1b-2bd7d544b562 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:51.781468 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-18beb7d3-7a4a-4a79-8f1b-2bd7d544b562 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:51.782848 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-18beb7d3-7a4a-4a79-8f1b-2bd7d544b562 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:51.783369 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-18beb7d3-7a4a-4a79-8f1b-2bd7d544b562 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:51.935325 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-18beb7d3-7a4a-4a79-8f1b-2bd7d544b562 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:51.944936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-18beb7d3-7a4a-4a79-8f1b-2bd7d544b562 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.175254 May 16 18:50:51.945501 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 146/286] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:51 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:52.975661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8ebea2ac-f8e4-46ea-bd8f-09736f33ed75 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:52.977352 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8ebea2ac-f8e4-46ea-bd8f-09736f33ed75 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:52.989238 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8ebea2ac-f8e4-46ea-bd8f-09736f33ed75 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:52.989787 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8ebea2ac-f8e4-46ea-bd8f-09736f33ed75 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:52.990669 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8ebea2ac-f8e4-46ea-bd8f-09736f33ed75 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:52.991148 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8ebea2ac-f8e4-46ea-bd8f-09736f33ed75 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:53.121076 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5540ecdd-1263-40ce-b885-d7452ffdb1e3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:53.121955 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5540ecdd-1263-40ce-b885-d7452ffdb1e3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:53.129635 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5540ecdd-1263-40ce-b885-d7452ffdb1e3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:53.130178 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5540ecdd-1263-40ce-b885-d7452ffdb1e3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:53.131006 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5540ecdd-1263-40ce-b885-d7452ffdb1e3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:53.131487 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5540ecdd-1263-40ce-b885-d7452ffdb1e3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:53.170298 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5540ecdd-1263-40ce-b885-d7452ffdb1e3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Going to try to terminate instance {{(pid=128886) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:50:53.307926 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5540ecdd-1263-40ce-b885-d7452ffdb1e3 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 204 len: 0 microversion: 2.1 time: 0.189834 May 16 18:50:53.307926 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 147/287] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:50:53 2022] DELETE /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 18:50:53.326887 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-37f9dfd1-683f-402f-a4c2-008317d6ea62 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:53.328484 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-37f9dfd1-683f-402f-a4c2-008317d6ea62 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:53.341687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-37f9dfd1-683f-402f-a4c2-008317d6ea62 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:53.342540 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-37f9dfd1-683f-402f-a4c2-008317d6ea62 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:53.344474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-37f9dfd1-683f-402f-a4c2-008317d6ea62 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:53.346123 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-37f9dfd1-683f-402f-a4c2-008317d6ea62 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:53.498328 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8ebea2ac-f8e4-46ea-bd8f-09736f33ed75 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:53.511255 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8ebea2ac-f8e4-46ea-bd8f-09736f33ed75 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.547761 May 16 18:50:53.512438 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 141/288] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:52 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:53.573465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-37f9dfd1-683f-402f-a4c2-008317d6ea62 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:53.585560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-37f9dfd1-683f-402f-a4c2-008317d6ea62 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1503 microversion: 2.1 time: 0.268549 May 16 18:50:53.586584 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 148/289] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:53 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:54.541703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8a8c4f4f-3a6d-42c2-add9-5065df343a00 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:54.542924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8a8c4f4f-3a6d-42c2-add9-5065df343a00 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:54.553700 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a8c4f4f-3a6d-42c2-add9-5065df343a00 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:54.554583 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a8c4f4f-3a6d-42c2-add9-5065df343a00 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:54.556049 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a8c4f4f-3a6d-42c2-add9-5065df343a00 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:54.556894 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a8c4f4f-3a6d-42c2-add9-5065df343a00 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:54.616584 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b81904f1-3e86-424d-b78d-3e2fa25c3695 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:54.617396 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b81904f1-3e86-424d-b78d-3e2fa25c3695 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:54.629932 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b81904f1-3e86-424d-b78d-3e2fa25c3695 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:54.630999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b81904f1-3e86-424d-b78d-3e2fa25c3695 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:54.632866 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b81904f1-3e86-424d-b78d-3e2fa25c3695 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:54.633575 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b81904f1-3e86-424d-b78d-3e2fa25c3695 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:54.825518 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8a8c4f4f-3a6d-42c2-add9-5065df343a00 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:54.837189 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8a8c4f4f-3a6d-42c2-add9-5065df343a00 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.301390 May 16 18:50:54.837980 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 142/290] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:54 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:54.863988 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b81904f1-3e86-424d-b78d-3e2fa25c3695 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:54.879125 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b81904f1-3e86-424d-b78d-3e2fa25c3695 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1503 microversion: 2.1 time: 0.266035 May 16 18:50:54.880174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 149/291] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:54 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:55.604988 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5a093819-7d77-4d6a-838d-4e6fa5249504 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5258563-86d2-46c5-b8ca-297c45483e60"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:55.607045 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5a093819-7d77-4d6a-838d-4e6fa5249504 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:55.618233 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5a093819-7d77-4d6a-838d-4e6fa5249504 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:55.618886 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5a093819-7d77-4d6a-838d-4e6fa5249504 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:55.620106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5a093819-7d77-4d6a-838d-4e6fa5249504 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:55.620795 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5a093819-7d77-4d6a-838d-4e6fa5249504 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:55.725942 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-80db8f02-e001-4e46-b3d4-5a55b8e2e545 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:55.726777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-80db8f02-e001-4e46-b3d4-5a55b8e2e545 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:55.734315 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-80db8f02-e001-4e46-b3d4-5a55b8e2e545 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:55.734759 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-80db8f02-e001-4e46-b3d4-5a55b8e2e545 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:55.736662 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-80db8f02-e001-4e46-b3d4-5a55b8e2e545 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:55.737222 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-80db8f02-e001-4e46-b3d4-5a55b8e2e545 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:55.769829 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-80db8f02-e001-4e46-b3d4-5a55b8e2e545 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/ips" status: 200 len: 151 microversion: 2.20 time: 0.050300 May 16 18:50:55.771571 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 150/292] 10.222.0.72 () {60 vars in 1288 bytes} [Mon May 16 18:50:55 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 18:50:55.859206 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7a0c3ece-ceb6-4991-91fc-6aa317c1ed67 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:55.860471 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7a0c3ece-ceb6-4991-91fc-6aa317c1ed67 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:55.868356 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7a0c3ece-ceb6-4991-91fc-6aa317c1ed67 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:55.869116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7a0c3ece-ceb6-4991-91fc-6aa317c1ed67 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:55.870085 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7a0c3ece-ceb6-4991-91fc-6aa317c1ed67 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:55.870917 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7a0c3ece-ceb6-4991-91fc-6aa317c1ed67 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:56.227930 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5a093819-7d77-4d6a-838d-4e6fa5249504 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.616638 May 16 18:50:56.229763 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 143/293] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:50:55 2022] POST /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/os-volume_attachments => generated 194 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:50:56.274187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5f9342dc-cddc-49c7-ac7d-92ab81a64a57 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:56.275351 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5f9342dc-cddc-49c7-ac7d-92ab81a64a57 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:56.321987 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f9342dc-cddc-49c7-ac7d-92ab81a64a57 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:56.322744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f9342dc-cddc-49c7-ac7d-92ab81a64a57 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:56.324127 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f9342dc-cddc-49c7-ac7d-92ab81a64a57 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:56.324843 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f9342dc-cddc-49c7-ac7d-92ab81a64a57 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:56.398917 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7a0c3ece-ceb6-4991-91fc-6aa317c1ed67 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:56.409298 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7a0c3ece-ceb6-4991-91fc-6aa317c1ed67 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.553825 May 16 18:50:56.410113 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 151/294] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:55 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:56.655666 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5f9342dc-cddc-49c7-ac7d-92ab81a64a57 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:56.670806 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5f9342dc-cddc-49c7-ac7d-92ab81a64a57 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1503 microversion: 2.1 time: 0.438876 May 16 18:50:56.671861 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 144/295] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:56 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1503 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:56.887521 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-8590fffd-c410-4af7-ac91-3a6beb6f8992 req-c7c74f0f-1e64-4557-8a86-3144d0e8551f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0bc9562-bdde-4c63-bd12-1e1972450781", "name": "network-vif-deleted", "tag": "700928d9-2f69-43d2-b6fe-da81609fa04d"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:56.903090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-8590fffd-c410-4af7-ac91-3a6beb6f8992 req-c7c74f0f-1e64-4557-8a86-3144d0e8551f service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:56.903733 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-8590fffd-c410-4af7-ac91-3a6beb6f8992 req-c7c74f0f-1e64-4557-8a86-3144d0e8551f service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:56.917529 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-8590fffd-c410-4af7-ac91-3a6beb6f8992 req-c7c74f0f-1e64-4557-8a86-3144d0e8551f service nova] Creating event network-vif-deleted:700928d9-2f69-43d2-b6fe-da81609fa04d for instance a0bc9562-bdde-4c63-bd12-1e1972450781 on hv-cinder-75078 May 16 18:50:56.929250 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-8590fffd-c410-4af7-ac91-3a6beb6f8992 req-c7c74f0f-1e64-4557-8a86-3144d0e8551f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046533 May 16 18:50:56.931193 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 152/296] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:50:57.430825 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d53bc18a-d245-4668-acf4-85d1b9482f34 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:57.432083 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d53bc18a-d245-4668-acf4-85d1b9482f34 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:57.444374 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d53bc18a-d245-4668-acf4-85d1b9482f34 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:57.445145 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d53bc18a-d245-4668-acf4-85d1b9482f34 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:57.445946 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d53bc18a-d245-4668-acf4-85d1b9482f34 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:57.446570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d53bc18a-d245-4668-acf4-85d1b9482f34 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:57.693294 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d53bc18a-d245-4668-acf4-85d1b9482f34 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:57.696163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:57.697273 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:57.712003 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d53bc18a-d245-4668-acf4-85d1b9482f34 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.287127 May 16 18:50:57.714154 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 145/297] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:57 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:50:57.718213 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:57.724036 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:57.729749 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:57.730678 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:57.779816 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:57.780552 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:57.781239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lazy-loading 'fault' on Instance uuid a0bc9562-bdde-4c63-bd12-1e1972450781 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:50:57.853941 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:57.861768 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ece59aba-ba84-492a-abc8-d119aafdfbcb tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 200 len: 1304 microversion: 2.1 time: 0.174428 May 16 18:50:57.862732 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 153/298] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:57 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:58.775888 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3b7758ef-ff53-4507-a420-98f6a3e433f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:58.779966 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-3b7758ef-ff53-4507-a420-98f6a3e433f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:58.793772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3b7758ef-ff53-4507-a420-98f6a3e433f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:58.794532 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3b7758ef-ff53-4507-a420-98f6a3e433f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:58.795850 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3b7758ef-ff53-4507-a420-98f6a3e433f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:58.796503 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3b7758ef-ff53-4507-a420-98f6a3e433f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:58.890933 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0a23108b-9157-405b-ba9d-1c217d711d81 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:58.892474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0a23108b-9157-405b-ba9d-1c217d711d81 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: a0bc9562-bdde-4c63-bd12-1e1972450781] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:58.906735 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a23108b-9157-405b-ba9d-1c217d711d81 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:58.907221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a23108b-9157-405b-ba9d-1c217d711d81 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:58.908665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a23108b-9157-405b-ba9d-1c217d711d81 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:58.909327 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a23108b-9157-405b-ba9d-1c217d711d81 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:58.927845 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-0a23108b-9157-405b-ba9d-1c217d711d81 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] HTTP exception thrown: Instance a0bc9562-bdde-4c63-bd12-1e1972450781 could not be found. May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0a23108b-9157-405b-ba9d-1c217d711d81 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Request method failure captured: May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 HTTP/1.1 May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpzsm6pU0SyuRdbpBbgG-hFvz-eIcfca8zLNhR_45sJ5FTHbNBlG4o_neQ43y138XNRfvEe6VNZeQrD4sRknDQpn0OT9m__pYVtwNyR43xB48tJjQgcO3Y3Am8tWHmD6B1sxwYuAbL4PP--ReKM169_v9bAiqNOXk-sg27iVsZKo0M0 May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: b7c0f4a8f9e04a71a6b71e704c29437a May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesActionsTest-1215153456 May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:50:58.930084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b7c0f4a8f9e04a71a6b71e704c29437a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b7c0f4a8f9e04a71a6b71e704c29437a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b7c0f4a8f9e04a71a6b71e704c29437a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b7c0f4a8f9e04a71a6b71e704c29437a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesActionsTest-1215153456 May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: b7c0f4a8f9e04a71a6b71e704c29437a May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesActionsTest-1215153456 May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesActionsTest-1215153456-project May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 4d2178471fe6400ea4db132f72bc334e May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesActionsTest-1215153456-project May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance a0bc9562-bdde-4c63-bd12-1e1972450781 could not be found. May 16 18:50:58.932861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'a0bc9562-bdde-4c63-bd12-1e1972450781'} May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0bc9562-bdde-4c63-bd12-1e1972450781 could not be found. May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:50:58.934116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0bc9562-bdde-4c63-bd12-1e1972450781 could not be found. May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0bc9562-bdde-4c63-bd12-1e1972450781 could not be found. May 16 18:50:58.935333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:50:58.956298 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0a23108b-9157-405b-ba9d-1c217d711d81 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Returning 404 to user: Instance a0bc9562-bdde-4c63-bd12-1e1972450781 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:50:58.959089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0a23108b-9157-405b-ba9d-1c217d711d81 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781" status: 404 len: 111 microversion: 2.1 time: 0.073778 May 16 18:50:58.961952 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 154/299] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:58 2022] GET /compute/v2.1/servers/a0bc9562-bdde-4c63-bd12-1e1972450781 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:50:59.161636 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-3b7758ef-ff53-4507-a420-98f6a3e433f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:50:59.179399 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3b7758ef-ff53-4507-a420-98f6a3e433f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.445974 May 16 18:50:59.180101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 146/300] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:50:58 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:50:59.189794 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1708943599", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "networks": [{"uuid": "261510c2-077b-471e-9a81-d70bdede9295"}]}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:59.270978 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.network.neutron [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] validate_networks() for [('261510c2-077b-471e-9a81-d70bdede9295', None, None, None, None, None)] {{(pid=128886) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:50:59.447765 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e4465b04-2564-4dd9-9345-61c179ccc754 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:50:59.448949 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e4465b04-2564-4dd9-9345-61c179ccc754 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:59.460733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e4465b04-2564-4dd9-9345-61c179ccc754 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:59.461852 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e4465b04-2564-4dd9-9345-61c179ccc754 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:59.463555 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e4465b04-2564-4dd9-9345-61c179ccc754 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:59.464603 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e4465b04-2564-4dd9-9345-61c179ccc754 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:59.514350 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-e4465b04-2564-4dd9-9345-61c179ccc754 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lazy-loading 'flavor' on Instance uuid 4de1432f-5419-4150-84a0-0fe456962ce9 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:50:59.901631 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Flavor limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:50:59.902169 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Image limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:50:59.903068 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Flavor pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:50:59.903820 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Image pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:50:59.904525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:50:59.946714 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:59.948110 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:59.950243 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:59.950899 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:59.967533 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e4465b04-2564-4dd9-9345-61c179ccc754 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "POST /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/action" status: 202 len: 0 microversion: 2.20 time: 0.526587 May 16 18:50:59.971798 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 147/301] 10.222.0.72 () {62 vars in 1318 bytes} [Mon May 16 18:50:59 2022] POST /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 18:50:59.980542 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Getting quotas for project b7c0f4a8f9e04a71a6b71e704c29437a. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:50:59.982839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-29abc48e-20d8-4385-81bd-cfe546100a2d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:50:59.983554 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-29abc48e-20d8-4385-81bd-cfe546100a2d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:50:59.989626 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Getting quotas for user 4d2178471fe6400ea4db132f72bc334e and project b7c0f4a8f9e04a71a6b71e704c29437a. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:50:59.991112 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29abc48e-20d8-4385-81bd-cfe546100a2d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:59.991755 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29abc48e-20d8-4385-81bd-cfe546100a2d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:50:59.992602 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29abc48e-20d8-4385-81bd-cfe546100a2d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:50:59.993096 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29abc48e-20d8-4385-81bd-cfe546100a2d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:00.017000 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Going to run 1 instances... {{(pid=128886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:51:00.027485 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:51:00.124355 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-95ef8b87-c4c0-48c5-8102-389da28e7ad8 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941910 May 16 18:51:00.125618 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 155/302] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 18:51:00.140247 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-868a5365-f266-4800-94bf-448d3f84d251 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:00.141233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-868a5365-f266-4800-94bf-448d3f84d251 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:00.234395 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-29abc48e-20d8-4385-81bd-cfe546100a2d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:00.267136 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-29abc48e-20d8-4385-81bd-cfe546100a2d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:00.274996 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-29abc48e-20d8-4385-81bd-cfe546100a2d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:00.282683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-29abc48e-20d8-4385-81bd-cfe546100a2d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.304181 May 16 18:51:00.303377 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 148/303] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:50:59 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:00.335202 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-dcd649c4-cc3b-415c-b899-6c7d275f6048 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:00.339960 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-dcd649c4-cc3b-415c-b899-6c7d275f6048 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:00.349222 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-868a5365-f266-4800-94bf-448d3f84d251 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:00.371080 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dcd649c4-cc3b-415c-b899-6c7d275f6048 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:00.371542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dcd649c4-cc3b-415c-b899-6c7d275f6048 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:00.372325 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-868a5365-f266-4800-94bf-448d3f84d251 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1214 microversion: 2.1 time: 0.235940 May 16 18:51:00.372546 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dcd649c4-cc3b-415c-b899-6c7d275f6048 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:00.372789 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dcd649c4-cc3b-415c-b899-6c7d275f6048 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:00.387280 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 156/304] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:00 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1214 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:00.647206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-dcd649c4-cc3b-415c-b899-6c7d275f6048 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:00.666528 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-dcd649c4-cc3b-415c-b899-6c7d275f6048 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.359365 May 16 18:51:00.678837 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 149/305] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:00 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:01.311983 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c59a5420-fe0e-4765-bfd4-452485c15834 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:01.313223 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c59a5420-fe0e-4765-bfd4-452485c15834 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:01.323300 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c59a5420-fe0e-4765-bfd4-452485c15834 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:01.324113 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c59a5420-fe0e-4765-bfd4-452485c15834 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:01.325208 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c59a5420-fe0e-4765-bfd4-452485c15834 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:01.325731 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c59a5420-fe0e-4765-bfd4-452485c15834 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:01.416155 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e6cd82af-0aea-43d1-a28d-d61db4d98bb9 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:01.418477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e6cd82af-0aea-43d1-a28d-d61db4d98bb9 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:01.444313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e6cd82af-0aea-43d1-a28d-d61db4d98bb9 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:01.445444 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e6cd82af-0aea-43d1-a28d-d61db4d98bb9 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:01.447015 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e6cd82af-0aea-43d1-a28d-d61db4d98bb9 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:01.447997 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e6cd82af-0aea-43d1-a28d-d61db4d98bb9 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:01.610597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e6cd82af-0aea-43d1-a28d-d61db4d98bb9 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:01.617348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c59a5420-fe0e-4765-bfd4-452485c15834 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:01.627258 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e6cd82af-0aea-43d1-a28d-d61db4d98bb9 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1210 microversion: 2.1 time: 0.218484 May 16 18:51:01.640305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 150/306] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:01 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1210 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:01.677712 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c59a5420-fe0e-4765-bfd4-452485c15834 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:01.687531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c59a5420-fe0e-4765-bfd4-452485c15834 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:01.689462 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c59a5420-fe0e-4765-bfd4-452485c15834 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.383305 May 16 18:51:01.691899 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 157/307] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:01 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:01.700229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ef2b3c20-bf85-433d-97e3-c7ec4113ade6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:01.703466 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ef2b3c20-bf85-433d-97e3-c7ec4113ade6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:01.728457 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ef2b3c20-bf85-433d-97e3-c7ec4113ade6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:01.729046 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ef2b3c20-bf85-433d-97e3-c7ec4113ade6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:01.729946 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ef2b3c20-bf85-433d-97e3-c7ec4113ade6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:01.730553 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ef2b3c20-bf85-433d-97e3-c7ec4113ade6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:01.977204 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ef2b3c20-bf85-433d-97e3-c7ec4113ade6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:01.991038 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ef2b3c20-bf85-433d-97e3-c7ec4113ade6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.299886 May 16 18:51:02.001022 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 151/308] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:01 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:02.234862 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a70e2651-ebe1-49c0-b7da-d397c29d7c43 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: .version_select at 0x7f64680381f0>, body: {"keypair": {"name": "tempest-keypair-431365184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkUZiusZby/2vowdyzdVVNKmI1B1bQEU/9dilGfpcSZEF3bZ5LHDlcrPUizvwhyNI8L+4ZQLkUqviIRiUWp6IoaPl9Zw8xT/YSjjWL5B5hK7FP2hFxXBaei+kEvx7IBZw=="}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:02.253590 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-a70e2651-ebe1-49c0-b7da-d397c29d7c43 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:51:02.258534 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-a70e2651-ebe1-49c0-b7da-d397c29d7c43 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for user cd0d8acbe24d410690470e3d9d4882b1 and project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:51:02.293989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a70e2651-ebe1-49c0-b7da-d397c29d7c43 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064238 May 16 18:51:02.304136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 158/309] 10.222.0.72 () {60 vars in 1158 bytes} [Mon May 16 18:51:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:02.670849 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a5e7bfa1-d524-4d11-98ad-7369e7f1ad0e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:02.699680 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a5e7bfa1-d524-4d11-98ad-7369e7f1ad0e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:02.723130 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b8bb0f14-37ba-4216-842b-92b3b8ad194e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:02.724000 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b8bb0f14-37ba-4216-842b-92b3b8ad194e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:02.743115 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a5e7bfa1-d524-4d11-98ad-7369e7f1ad0e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:02.743115 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a5e7bfa1-d524-4d11-98ad-7369e7f1ad0e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:02.743115 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a5e7bfa1-d524-4d11-98ad-7369e7f1ad0e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:02.743115 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a5e7bfa1-d524-4d11-98ad-7369e7f1ad0e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:02.773384 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b8bb0f14-37ba-4216-842b-92b3b8ad194e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:02.774018 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b8bb0f14-37ba-4216-842b-92b3b8ad194e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:02.780091 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b8bb0f14-37ba-4216-842b-92b3b8ad194e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:02.783104 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b8bb0f14-37ba-4216-842b-92b3b8ad194e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:03.191671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a5e7bfa1-d524-4d11-98ad-7369e7f1ad0e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:03.212681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a5e7bfa1-d524-4d11-98ad-7369e7f1ad0e tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1284 microversion: 2.1 time: 0.567428 May 16 18:51:03.225261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 152/310] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:02 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1284 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:03.243362 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-86c1028b-20bd-44f1-af5b-6f15940880ef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:03.244334 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-86c1028b-20bd-44f1-af5b-6f15940880ef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:03.270298 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86c1028b-20bd-44f1-af5b-6f15940880ef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:03.271166 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86c1028b-20bd-44f1-af5b-6f15940880ef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:03.272329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86c1028b-20bd-44f1-af5b-6f15940880ef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:03.273065 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86c1028b-20bd-44f1-af5b-6f15940880ef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:03.716332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b8bb0f14-37ba-4216-842b-92b3b8ad194e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:03.752474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b8bb0f14-37ba-4216-842b-92b3b8ad194e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:03.767918 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b8bb0f14-37ba-4216-842b-92b3b8ad194e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:03.774895 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b8bb0f14-37ba-4216-842b-92b3b8ad194e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 1.067492 May 16 18:51:03.782433 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 159/311] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:02 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:03.830410 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-86c1028b-20bd-44f1-af5b-6f15940880ef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:03.851140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-86c1028b-20bd-44f1-af5b-6f15940880ef tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.623733 May 16 18:51:03.852063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 153/312] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:03 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:04.257266 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-303f3d90-2f14-499f-bc28-e47d4433d118 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:04.260706 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-303f3d90-2f14-499f-bc28-e47d4433d118 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:04.272627 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-303f3d90-2f14-499f-bc28-e47d4433d118 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:04.273574 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-303f3d90-2f14-499f-bc28-e47d4433d118 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:04.274899 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-303f3d90-2f14-499f-bc28-e47d4433d118 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:04.275697 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-303f3d90-2f14-499f-bc28-e47d4433d118 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:04.463388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-303f3d90-2f14-499f-bc28-e47d4433d118 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:04.472750 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-303f3d90-2f14-499f-bc28-e47d4433d118 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1272 microversion: 2.1 time: 0.225263 May 16 18:51:04.483679 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 160/313] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:04 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1272 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:04.811230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c424c53e-28be-4dd1-af11-73c7c775c810 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:04.812734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c424c53e-28be-4dd1-af11-73c7c775c810 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:04.831476 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c424c53e-28be-4dd1-af11-73c7c775c810 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:04.835468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c424c53e-28be-4dd1-af11-73c7c775c810 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:04.838291 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c424c53e-28be-4dd1-af11-73c7c775c810 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:04.840515 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c424c53e-28be-4dd1-af11-73c7c775c810 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:04.870480 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-16dda3fc-640a-440a-bfa8-71a459317f63 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:04.872090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-16dda3fc-640a-440a-bfa8-71a459317f63 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:04.891803 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16dda3fc-640a-440a-bfa8-71a459317f63 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:04.893525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16dda3fc-640a-440a-bfa8-71a459317f63 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:04.898053 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16dda3fc-640a-440a-bfa8-71a459317f63 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:04.902175 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16dda3fc-640a-440a-bfa8-71a459317f63 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:05.647002 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c424c53e-28be-4dd1-af11-73c7c775c810 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:05.659023 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c424c53e-28be-4dd1-af11-73c7c775c810 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:05.660730 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c424c53e-28be-4dd1-af11-73c7c775c810 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:05.662005 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c424c53e-28be-4dd1-af11-73c7c775c810 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.858986 May 16 18:51:05.662562 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 154/314] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:04 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:05.668448 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-253925125", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "236a317a-f889-44df-b53d-ac5f81a24b24"}], "security_groups": [{"name": "tempest-securitygroup--1775757170"}], "key_name": "tempest-keypair-431365184", "user_data": "}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:05.803894 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-16dda3fc-640a-440a-bfa8-71a459317f63 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:05.816767 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-16dda3fc-640a-440a-bfa8-71a459317f63 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.950612 May 16 18:51:05.817268 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 161/315] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:04 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:05.834457 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f54d708d-3cb3-49d7-9d88-a591af2d83ba tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:05.835066 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f54d708d-3cb3-49d7-9d88-a591af2d83ba tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:05.842241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f54d708d-3cb3-49d7-9d88-a591af2d83ba tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:05.842704 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f54d708d-3cb3-49d7-9d88-a591af2d83ba tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:05.843515 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f54d708d-3cb3-49d7-9d88-a591af2d83ba tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:05.844981 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f54d708d-3cb3-49d7-9d88-a591af2d83ba tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:06.178096 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] validate_networks() for [('236a317a-f889-44df-b53d-ac5f81a24b24', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:51:06.474995 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f54d708d-3cb3-49d7-9d88-a591af2d83ba tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:06.490186 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f54d708d-3cb3-49d7-9d88-a591af2d83ba tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1314 microversion: 2.1 time: 0.671114 May 16 18:51:06.500036 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 162/316] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:05 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:06.694142 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-05db95ba-6a4d-44fa-aab3-58c0b460be65 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:06.694886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-05db95ba-6a4d-44fa-aab3-58c0b460be65 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:06.703054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-05db95ba-6a4d-44fa-aab3-58c0b460be65 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:06.704401 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-05db95ba-6a4d-44fa-aab3-58c0b460be65 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:06.706000 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-05db95ba-6a4d-44fa-aab3-58c0b460be65 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:06.706536 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-05db95ba-6a4d-44fa-aab3-58c0b460be65 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:07.186691 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-05db95ba-6a4d-44fa-aab3-58c0b460be65 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:07.202921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-05db95ba-6a4d-44fa-aab3-58c0b460be65 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:07.207999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-05db95ba-6a4d-44fa-aab3-58c0b460be65 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:07.210756 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-05db95ba-6a4d-44fa-aab3-58c0b460be65 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.521561 May 16 18:51:07.212024 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 163/317] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:06 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:51:07.227262 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-34aa9ab9-565b-4e62-8451-834b9202f8bd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:07.228574 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-34aa9ab9-565b-4e62-8451-834b9202f8bd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:07.245371 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-34aa9ab9-565b-4e62-8451-834b9202f8bd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:07.246583 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-34aa9ab9-565b-4e62-8451-834b9202f8bd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:07.248306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-34aa9ab9-565b-4e62-8451-834b9202f8bd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:07.249370 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-34aa9ab9-565b-4e62-8451-834b9202f8bd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:07.572446 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:51:07.572980 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:51:07.574373 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:51:07.574794 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:51:07.575209 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:51:07.588831 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:07.590565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:07.593187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:07.593870 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:07.632451 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:51:07.640416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for user cd0d8acbe24d410690470e3d9d4882b1 and project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:51:07.663312 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:51:07.665800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:51:07.720688 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-34aa9ab9-565b-4e62-8451-834b9202f8bd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:07.734547 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-39c00ee0-17e7-49de-8338-c83d3114ccc8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.069490 May 16 18:51:07.740610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 155/318] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:51:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 2077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:51:07.748973 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-12c5f6fd-d588-4c33-879e-d5af9c04c6b7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:07.749208 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-12c5f6fd-d588-4c33-879e-d5af9c04c6b7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:07.763476 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-12c5f6fd-d588-4c33-879e-d5af9c04c6b7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:07.764946 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-12c5f6fd-d588-4c33-879e-d5af9c04c6b7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:07.767174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-12c5f6fd-d588-4c33-879e-d5af9c04c6b7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:07.768211 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-12c5f6fd-d588-4c33-879e-d5af9c04c6b7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:07.771561 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-34aa9ab9-565b-4e62-8451-834b9202f8bd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.542951 May 16 18:51:07.772203 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 164/319] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:07 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:07.790402 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-143e7724-a62a-47a9-aced-b9251200b305 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:07.793438 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-143e7724-a62a-47a9-aced-b9251200b305 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:08.012517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-143e7724-a62a-47a9-aced-b9251200b305 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:08.030559 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-143e7724-a62a-47a9-aced-b9251200b305 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1240 microversion: 2.1 time: 0.254847 May 16 18:51:08.034234 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 165/320] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:07 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1240 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:08.045504 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-9d80dcc2-788b-434f-b2ff-2be0836911f3 req-75348e00-4e02-4d9c-9eb0-6bef36227b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb2c41a-d2d7-4e2a-8800-91fb33ef5def", "tag": "2208d25f-6682-4ab4-8ac8-158028b26ee7"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:08.067833 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-9d80dcc2-788b-434f-b2ff-2be0836911f3 req-75348e00-4e02-4d9c-9eb0-6bef36227b07 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:08.068899 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-9d80dcc2-788b-434f-b2ff-2be0836911f3 req-75348e00-4e02-4d9c-9eb0-6bef36227b07 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:08.082764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-9d80dcc2-788b-434f-b2ff-2be0836911f3 req-75348e00-4e02-4d9c-9eb0-6bef36227b07 service nova] Creating event network-changed:2208d25f-6682-4ab4-8ac8-158028b26ee7 for instance 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def on hv-cinder-75078 May 16 18:51:08.089942 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-9d80dcc2-788b-434f-b2ff-2be0836911f3 req-75348e00-4e02-4d9c-9eb0-6bef36227b07 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053800 May 16 18:51:08.091111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 166/321] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:08.177509 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-12c5f6fd-d588-4c33-879e-d5af9c04c6b7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:08.189728 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-12c5f6fd-d588-4c33-879e-d5af9c04c6b7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1314 microversion: 2.1 time: 0.447545 May 16 18:51:08.203193 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 156/322] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:07 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:08.256431 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-efa3028c-fa0c-4b7b-ac7a-e22f55e54944 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:08.257870 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-efa3028c-fa0c-4b7b-ac7a-e22f55e54944 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:08.276864 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-efa3028c-fa0c-4b7b-ac7a-e22f55e54944 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:08.277641 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-efa3028c-fa0c-4b7b-ac7a-e22f55e54944 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:08.280544 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-efa3028c-fa0c-4b7b-ac7a-e22f55e54944 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:08.281412 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-efa3028c-fa0c-4b7b-ac7a-e22f55e54944 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:08.632456 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-efa3028c-fa0c-4b7b-ac7a-e22f55e54944 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:08.656446 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-efa3028c-fa0c-4b7b-ac7a-e22f55e54944 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:08.663087 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-efa3028c-fa0c-4b7b-ac7a-e22f55e54944 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:08.667318 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-efa3028c-fa0c-4b7b-ac7a-e22f55e54944 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.426963 May 16 18:51:08.667983 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 167/323] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:08 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:08.796352 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0b401ad4-922e-464d-9e64-1bd5d010046e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:08.798761 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0b401ad4-922e-464d-9e64-1bd5d010046e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:08.810738 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0b401ad4-922e-464d-9e64-1bd5d010046e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:08.811195 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0b401ad4-922e-464d-9e64-1bd5d010046e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:08.812021 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0b401ad4-922e-464d-9e64-1bd5d010046e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:08.812654 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0b401ad4-922e-464d-9e64-1bd5d010046e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:09.043091 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0b401ad4-922e-464d-9e64-1bd5d010046e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:09.054407 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-30444910-af74-47f9-8355-d53d57babdcf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:09.055779 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-30444910-af74-47f9-8355-d53d57babdcf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:09.070986 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0b401ad4-922e-464d-9e64-1bd5d010046e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.281079 May 16 18:51:09.073190 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-30444910-af74-47f9-8355-d53d57babdcf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:09.074012 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-30444910-af74-47f9-8355-d53d57babdcf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:09.075027 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-30444910-af74-47f9-8355-d53d57babdcf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:09.086976 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-30444910-af74-47f9-8355-d53d57babdcf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:09.088122 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 157/324] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:08 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:09.209265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e8fa3bb9-585e-44c1-a019-47b39ef72dcc tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:09.209946 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e8fa3bb9-585e-44c1-a019-47b39ef72dcc tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:09.223481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e8fa3bb9-585e-44c1-a019-47b39ef72dcc tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:09.224197 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e8fa3bb9-585e-44c1-a019-47b39ef72dcc tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:09.225298 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e8fa3bb9-585e-44c1-a019-47b39ef72dcc tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:09.225729 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e8fa3bb9-585e-44c1-a019-47b39ef72dcc tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:09.315338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-30444910-af74-47f9-8355-d53d57babdcf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:09.358670 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-30444910-af74-47f9-8355-d53d57babdcf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1236 microversion: 2.1 time: 0.302942 May 16 18:51:09.359701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 168/325] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:09 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1236 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:09.452924 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1940923764", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1844395528", "security_groups": [{"name": "tempest-secgroup-smoke-1897508092"}], "networks": [{"uuid": "d80de480-7bd7-488b-b9fb-bd1908d6b618"}], "block_device_mapping_v2": [{"uuid": "fe54ed26-b64e-41e3-8601-a3d30a9505f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:09.546849 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e8fa3bb9-585e-44c1-a019-47b39ef72dcc tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:09.555432 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e8fa3bb9-585e-44c1-a019-47b39ef72dcc tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1314 microversion: 2.1 time: 0.351228 May 16 18:51:09.557546 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 158/326] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:09 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:09.688765 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-daeda60f-aaa0-4d35-991a-e23e6a02746a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:09.689516 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-daeda60f-aaa0-4d35-991a-e23e6a02746a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:09.700728 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daeda60f-aaa0-4d35-991a-e23e6a02746a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:09.701192 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daeda60f-aaa0-4d35-991a-e23e6a02746a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:09.704939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daeda60f-aaa0-4d35-991a-e23e6a02746a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:09.705639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daeda60f-aaa0-4d35-991a-e23e6a02746a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:10.227149 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.network.neutron [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] validate_networks() for [('d80de480-7bd7-488b-b9fb-bd1908d6b618', None, None, None, None, None)] {{(pid=128886) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:51:10.510564 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-daeda60f-aaa0-4d35-991a-e23e6a02746a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:10.520300 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-daeda60f-aaa0-4d35-991a-e23e6a02746a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:10.522673 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-daeda60f-aaa0-4d35-991a-e23e6a02746a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:10.524401 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-daeda60f-aaa0-4d35-991a-e23e6a02746a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.840800 May 16 18:51:10.525357 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 159/327] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:09 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:51:10.531697 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-bcc15926-e1c2-46d7-afda-64146a06ea3e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:10.545422 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bcc15926-e1c2-46d7-afda-64146a06ea3e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:10.545881 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bcc15926-e1c2-46d7-afda-64146a06ea3e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:10.658426 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-bcc15926-e1c2-46d7-afda-64146a06ea3e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Going to try to stop instance {{(pid=128887) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 18:51:10.731061 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-bcc15926-e1c2-46d7-afda-64146a06ea3e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/action" status: 202 len: 0 microversion: 2.1 time: 0.202494 May 16 18:51:10.737533 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 160/328] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:51:10 2022] POST /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:51:10.743674 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e85446bc-581a-49ff-bb17-a5b99f837271 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:10.745397 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e85446bc-581a-49ff-bb17-a5b99f837271 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:10.756291 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e85446bc-581a-49ff-bb17-a5b99f837271 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:10.756993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e85446bc-581a-49ff-bb17-a5b99f837271 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:10.758354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e85446bc-581a-49ff-bb17-a5b99f837271 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:10.759429 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e85446bc-581a-49ff-bb17-a5b99f837271 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:11.207118 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e85446bc-581a-49ff-bb17-a5b99f837271 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:11.217101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e85446bc-581a-49ff-bb17-a5b99f837271 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.480273 May 16 18:51:11.218178 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 161/329] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:10 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:11.225565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-eaaded37-4f49-4d5c-9d98-a69a8144fa80 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:11.226527 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-eaaded37-4f49-4d5c-9d98-a69a8144fa80 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:11.238183 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eaaded37-4f49-4d5c-9d98-a69a8144fa80 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:11.239029 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eaaded37-4f49-4d5c-9d98-a69a8144fa80 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:11.241101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eaaded37-4f49-4d5c-9d98-a69a8144fa80 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:11.244717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eaaded37-4f49-4d5c-9d98-a69a8144fa80 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:11.261466 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Flavor limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:51:11.262328 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Image limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:51:11.262965 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Flavor pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:51:11.263441 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Image pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:51:11.264213 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:51:11.279829 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:11.280591 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:11.281643 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:11.282259 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:11.316499 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Getting quotas for project 405413536bdb433fbb7d03c8ccd34283. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:51:11.321567 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Getting quotas for user 258580b81cf0480d9728500884442b55 and project 405413536bdb433fbb7d03c8ccd34283. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:51:11.405184 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-eaaded37-4f49-4d5c-9d98-a69a8144fa80 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:11.436413 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-eaaded37-4f49-4d5c-9d98-a69a8144fa80 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1298 microversion: 2.1 time: 0.215940 May 16 18:51:11.442835 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 162/330] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:11 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:11.461014 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-975b9102-6e7d-42ad-b4c3-b3912a743b27 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:11.466698 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-975b9102-6e7d-42ad-b4c3-b3912a743b27 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:11.486048 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-975b9102-6e7d-42ad-b4c3-b3912a743b27 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:11.487855 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-975b9102-6e7d-42ad-b4c3-b3912a743b27 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:11.490684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-975b9102-6e7d-42ad-b4c3-b3912a743b27 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:11.491150 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-975b9102-6e7d-42ad-b4c3-b3912a743b27 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:11.501886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Going to run 1 instances... {{(pid=128886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:51:11.506882 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe54ed26-b64e-41e3-8601-a3d30a9505f4',volume_size=None,volume_type=None)] {{(pid=128886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:51:11.848794 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2465b66a-4d08-48a4-91bc-a77218d6cbfb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.402994 May 16 18:51:11.856972 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 169/331] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:51:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:51:11.865307 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-949c8d17-21f7-4378-9a2a-cdc379fe43b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:11.866937 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-949c8d17-21f7-4378-9a2a-cdc379fe43b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:11.879291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-949c8d17-21f7-4378-9a2a-cdc379fe43b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:11.879923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-949c8d17-21f7-4378-9a2a-cdc379fe43b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:11.880882 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-949c8d17-21f7-4378-9a2a-cdc379fe43b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:11.882565 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-949c8d17-21f7-4378-9a2a-cdc379fe43b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:11.919916 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-975b9102-6e7d-42ad-b4c3-b3912a743b27 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:11.961251 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-975b9102-6e7d-42ad-b4c3-b3912a743b27 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1314 microversion: 2.1 time: 0.497547 May 16 18:51:11.966748 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 163/332] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:11 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:11.985344 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-383ac7cb-1dea-467b-877d-2b3be72bbf8f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:11.986140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-383ac7cb-1dea-467b-877d-2b3be72bbf8f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:12.001646 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-383ac7cb-1dea-467b-877d-2b3be72bbf8f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:12.002633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-383ac7cb-1dea-467b-877d-2b3be72bbf8f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:12.003922 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-383ac7cb-1dea-467b-877d-2b3be72bbf8f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:12.004593 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-383ac7cb-1dea-467b-877d-2b3be72bbf8f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:12.624380 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-949c8d17-21f7-4378-9a2a-cdc379fe43b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:12.628106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-383ac7cb-1dea-467b-877d-2b3be72bbf8f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:12.642089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-949c8d17-21f7-4378-9a2a-cdc379fe43b4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.782939 May 16 18:51:12.643504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-383ac7cb-1dea-467b-877d-2b3be72bbf8f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:12.645561 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 170/333] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:11 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:12.653290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9d56d491-e435-4940-bb37-76e3630e5f44 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:12.654212 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9d56d491-e435-4940-bb37-76e3630e5f44 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:12.668194 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9d56d491-e435-4940-bb37-76e3630e5f44 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:12.670304 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9d56d491-e435-4940-bb37-76e3630e5f44 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:12.672796 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9d56d491-e435-4940-bb37-76e3630e5f44 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:12.673217 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-383ac7cb-1dea-467b-877d-2b3be72bbf8f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:12.674234 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9d56d491-e435-4940-bb37-76e3630e5f44 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:12.676244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-383ac7cb-1dea-467b-877d-2b3be72bbf8f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.707458 May 16 18:51:12.677260 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 164/334] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:11 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:12.695167 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ea959ba0-8fc6-48ee-ab6a-7ac5211cc2d1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:12.699601 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ea959ba0-8fc6-48ee-ab6a-7ac5211cc2d1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:12.719917 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ea959ba0-8fc6-48ee-ab6a-7ac5211cc2d1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:12.721297 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ea959ba0-8fc6-48ee-ab6a-7ac5211cc2d1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:12.722275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ea959ba0-8fc6-48ee-ab6a-7ac5211cc2d1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:12.722723 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ea959ba0-8fc6-48ee-ab6a-7ac5211cc2d1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:12.792064 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9d56d491-e435-4940-bb37-76e3630e5f44 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:12.803525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9d56d491-e435-4940-bb37-76e3630e5f44 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1139 microversion: 2.1 time: 0.156171 May 16 18:51:12.805814 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 171/335] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:12 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1139 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:12.823868 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9fd79590-b1f5-4bcb-9633-eab63c80ec83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:12.824814 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9fd79590-b1f5-4bcb-9633-eab63c80ec83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:12.836414 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9fd79590-b1f5-4bcb-9633-eab63c80ec83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:12.837507 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9fd79590-b1f5-4bcb-9633-eab63c80ec83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:12.839219 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9fd79590-b1f5-4bcb-9633-eab63c80ec83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:12.840524 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9fd79590-b1f5-4bcb-9633-eab63c80ec83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:12.980771 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9fd79590-b1f5-4bcb-9633-eab63c80ec83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:12.990563 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9fd79590-b1f5-4bcb-9633-eab63c80ec83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1298 microversion: 2.1 time: 0.183659 May 16 18:51:12.994634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 172/336] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:12 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1298 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:13.007757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d98409c4-1e8d-45e5-a587-cc6cd6bce554 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:13.008603 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d98409c4-1e8d-45e5-a587-cc6cd6bce554 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:13.020444 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d98409c4-1e8d-45e5-a587-cc6cd6bce554 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:13.023080 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d98409c4-1e8d-45e5-a587-cc6cd6bce554 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:13.024326 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d98409c4-1e8d-45e5-a587-cc6cd6bce554 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:13.024775 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d98409c4-1e8d-45e5-a587-cc6cd6bce554 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:13.176389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ea959ba0-8fc6-48ee-ab6a-7ac5211cc2d1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:13.185579 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ea959ba0-8fc6-48ee-ab6a-7ac5211cc2d1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.500458 May 16 18:51:13.186664 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 165/337] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:12 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:13.270781 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d98409c4-1e8d-45e5-a587-cc6cd6bce554 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:13.279315 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d98409c4-1e8d-45e5-a587-cc6cd6bce554 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1314 microversion: 2.1 time: 0.283370 May 16 18:51:13.279966 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 173/338] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:12 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:13.676373 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5da70c2c-a8a5-4527-a8fa-b8597cb04407 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:13.677945 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5da70c2c-a8a5-4527-a8fa-b8597cb04407 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:13.715685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-27647133-ed61-4cbc-bfa9-8594d67a327d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:13.717162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5da70c2c-a8a5-4527-a8fa-b8597cb04407 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:13.720881 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5da70c2c-a8a5-4527-a8fa-b8597cb04407 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:13.723021 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5da70c2c-a8a5-4527-a8fa-b8597cb04407 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:13.724556 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5da70c2c-a8a5-4527-a8fa-b8597cb04407 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:13.724998 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-27647133-ed61-4cbc-bfa9-8594d67a327d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:13.753552 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-27647133-ed61-4cbc-bfa9-8594d67a327d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:13.754647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-27647133-ed61-4cbc-bfa9-8594d67a327d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:13.760694 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-27647133-ed61-4cbc-bfa9-8594d67a327d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:13.761459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-27647133-ed61-4cbc-bfa9-8594d67a327d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:14.410143 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-27647133-ed61-4cbc-bfa9-8594d67a327d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:14.425246 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-27647133-ed61-4cbc-bfa9-8594d67a327d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:14.428842 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-27647133-ed61-4cbc-bfa9-8594d67a327d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:14.431197 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-27647133-ed61-4cbc-bfa9-8594d67a327d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.725173 May 16 18:51:14.447747 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5da70c2c-a8a5-4527-a8fa-b8597cb04407 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:14.449526 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 174/339] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:13 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:14.461874 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-831e6181-e12c-4501-8ce3-06db5fdc670d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:14.463078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-831e6181-e12c-4501-8ce3-06db5fdc670d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:14.473920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5da70c2c-a8a5-4527-a8fa-b8597cb04407 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.803722 May 16 18:51:14.474434 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-831e6181-e12c-4501-8ce3-06db5fdc670d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:14.475477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-831e6181-e12c-4501-8ce3-06db5fdc670d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:14.487249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 166/340] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:13 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:14.488792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-91738e4d-23e1-45e2-8e69-d527fbdcead8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:14.488927 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-831e6181-e12c-4501-8ce3-06db5fdc670d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:14.489507 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-831e6181-e12c-4501-8ce3-06db5fdc670d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:14.491477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-91738e4d-23e1-45e2-8e69-d527fbdcead8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:14.518238 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-91738e4d-23e1-45e2-8e69-d527fbdcead8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:14.519454 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-91738e4d-23e1-45e2-8e69-d527fbdcead8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:14.521459 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-91738e4d-23e1-45e2-8e69-d527fbdcead8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:14.522887 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-91738e4d-23e1-45e2-8e69-d527fbdcead8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:14.645896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-831e6181-e12c-4501-8ce3-06db5fdc670d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:14.670900 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-831e6181-e12c-4501-8ce3-06db5fdc670d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1187 microversion: 2.1 time: 0.219201 May 16 18:51:14.675163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 175/341] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:14 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1187 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:14.707444 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b0a2c809-6f55-4141-868c-7a6d489807fb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:14.708665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b0a2c809-6f55-4141-868c-7a6d489807fb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:14.725529 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b0a2c809-6f55-4141-868c-7a6d489807fb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:14.726328 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b0a2c809-6f55-4141-868c-7a6d489807fb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:14.727760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b0a2c809-6f55-4141-868c-7a6d489807fb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:14.728556 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b0a2c809-6f55-4141-868c-7a6d489807fb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:14.729305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-91738e4d-23e1-45e2-8e69-d527fbdcead8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:14.741900 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-91738e4d-23e1-45e2-8e69-d527fbdcead8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1298 microversion: 2.1 time: 0.263450 May 16 18:51:14.748997 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 167/342] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:14 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1298 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:14.758553 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2b31ba93-a300-4102-b0c6-0797a141048b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:14.760365 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2b31ba93-a300-4102-b0c6-0797a141048b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:14.782945 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2b31ba93-a300-4102-b0c6-0797a141048b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:14.787495 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2b31ba93-a300-4102-b0c6-0797a141048b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:14.791470 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2b31ba93-a300-4102-b0c6-0797a141048b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:14.792880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2b31ba93-a300-4102-b0c6-0797a141048b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:15.445399 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2b31ba93-a300-4102-b0c6-0797a141048b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:15.470789 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b0a2c809-6f55-4141-868c-7a6d489807fb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:15.499233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b0a2c809-6f55-4141-868c-7a6d489807fb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1520 microversion: 2.1 time: 0.821483 May 16 18:51:15.503217 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2b31ba93-a300-4102-b0c6-0797a141048b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1314 microversion: 2.1 time: 0.752698 May 16 18:51:15.504531 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 168/343] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:14 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:15.523765 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 176/344] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:14 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1520 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:15.528790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d4705910-c05e-4da3-8db6-a3c1bf160a0f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:15.529432 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-dc6c93a1-57d4-4bc7-bfcd-86b5a759dc4f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:15.530263 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-dc6c93a1-57d4-4bc7-bfcd-86b5a759dc4f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:15.533495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d4705910-c05e-4da3-8db6-a3c1bf160a0f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:15.545637 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dc6c93a1-57d4-4bc7-bfcd-86b5a759dc4f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:15.546484 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dc6c93a1-57d4-4bc7-bfcd-86b5a759dc4f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:15.548091 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dc6c93a1-57d4-4bc7-bfcd-86b5a759dc4f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:15.548703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dc6c93a1-57d4-4bc7-bfcd-86b5a759dc4f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:15.551811 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d4705910-c05e-4da3-8db6-a3c1bf160a0f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:15.552451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d4705910-c05e-4da3-8db6-a3c1bf160a0f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:15.553407 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d4705910-c05e-4da3-8db6-a3c1bf160a0f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:15.554273 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d4705910-c05e-4da3-8db6-a3c1bf160a0f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:15.991368 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-dc6c93a1-57d4-4bc7-bfcd-86b5a759dc4f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:16.001090 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-dc6c93a1-57d4-4bc7-bfcd-86b5a759dc4f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:16.003269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-dc6c93a1-57d4-4bc7-bfcd-86b5a759dc4f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:16.004953 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-dc6c93a1-57d4-4bc7-bfcd-86b5a759dc4f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.490003 May 16 18:51:16.005817 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 169/345] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:15 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:16.011838 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d87a2e56-ae17-4df4-8278-13e10981fe54 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:16.012830 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d87a2e56-ae17-4df4-8278-13e10981fe54 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:16.020430 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d87a2e56-ae17-4df4-8278-13e10981fe54 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:16.021026 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d87a2e56-ae17-4df4-8278-13e10981fe54 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:16.022079 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d87a2e56-ae17-4df4-8278-13e10981fe54 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:16.022768 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d87a2e56-ae17-4df4-8278-13e10981fe54 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:16.027622 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d4705910-c05e-4da3-8db6-a3c1bf160a0f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:16.041999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d4705910-c05e-4da3-8db6-a3c1bf160a0f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.524090 May 16 18:51:16.042590 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 177/346] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:15 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:16.051593 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-10705269-8064-48a3-9f3d-14549149f95d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:16.057842 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-10705269-8064-48a3-9f3d-14549149f95d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:16.068616 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-10705269-8064-48a3-9f3d-14549149f95d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:16.070897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-10705269-8064-48a3-9f3d-14549149f95d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:16.078164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-10705269-8064-48a3-9f3d-14549149f95d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:16.079161 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-10705269-8064-48a3-9f3d-14549149f95d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:16.466294 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d87a2e56-ae17-4df4-8278-13e10981fe54 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:16.476230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d87a2e56-ae17-4df4-8278-13e10981fe54 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1205 microversion: 2.1 time: 0.468774 May 16 18:51:16.477651 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 170/347] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:16 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1205 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:16.522310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0f4c506d-7eb8-4419-8830-d9695dec7936 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:16.523436 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0f4c506d-7eb8-4419-8830-d9695dec7936 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:16.567417 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0f4c506d-7eb8-4419-8830-d9695dec7936 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:16.572326 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0f4c506d-7eb8-4419-8830-d9695dec7936 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:16.575444 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0f4c506d-7eb8-4419-8830-d9695dec7936 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:16.580708 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0f4c506d-7eb8-4419-8830-d9695dec7936 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:16.986414 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-10705269-8064-48a3-9f3d-14549149f95d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:16.996345 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-10705269-8064-48a3-9f3d-14549149f95d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.952430 May 16 18:51:17.007109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 178/348] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:16 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:17.012325 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d1a59de4-5ba7-472c-b9f7-5d3c81742d4c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:17.012942 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d1a59de4-5ba7-472c-b9f7-5d3c81742d4c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:17.021702 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1a59de4-5ba7-472c-b9f7-5d3c81742d4c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.022155 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1a59de4-5ba7-472c-b9f7-5d3c81742d4c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:17.022989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1a59de4-5ba7-472c-b9f7-5d3c81742d4c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.023676 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1a59de4-5ba7-472c-b9f7-5d3c81742d4c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:17.215661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0f4c506d-7eb8-4419-8830-d9695dec7936 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:17.244972 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0f4c506d-7eb8-4419-8830-d9695dec7936 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1314 microversion: 2.1 time: 0.728250 May 16 18:51:17.246294 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 171/349] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:16 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:17.259692 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2abec0ef-5b05-4ff9-aabb-52f11092a7eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:17.260813 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2abec0ef-5b05-4ff9-aabb-52f11092a7eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:17.278824 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2abec0ef-5b05-4ff9-aabb-52f11092a7eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.284442 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2abec0ef-5b05-4ff9-aabb-52f11092a7eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:17.285477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2abec0ef-5b05-4ff9-aabb-52f11092a7eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.286118 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2abec0ef-5b05-4ff9-aabb-52f11092a7eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:17.524314 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d1a59de4-5ba7-472c-b9f7-5d3c81742d4c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:17.540292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d1a59de4-5ba7-472c-b9f7-5d3c81742d4c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1500 microversion: 2.1 time: 0.530132 May 16 18:51:17.542583 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 179/350] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:17 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1500 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:17.551704 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0c501236-f524-4a9f-9349-9d682fb1f715 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:17.552952 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0c501236-f524-4a9f-9349-9d682fb1f715 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:17.568982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0c501236-f524-4a9f-9349-9d682fb1f715 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.570873 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0c501236-f524-4a9f-9349-9d682fb1f715 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:17.572816 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0c501236-f524-4a9f-9349-9d682fb1f715 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.573853 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0c501236-f524-4a9f-9349-9d682fb1f715 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:17.754620 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2abec0ef-5b05-4ff9-aabb-52f11092a7eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:17.771603 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2abec0ef-5b05-4ff9-aabb-52f11092a7eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:17.774460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2abec0ef-5b05-4ff9-aabb-52f11092a7eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:17.777010 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2abec0ef-5b05-4ff9-aabb-52f11092a7eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.529192 May 16 18:51:17.779028 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 172/351] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:17 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:17.787727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-32dda319-35e1-47f6-a3ae-744731c0f0fa req-b4f367e6-6b3a-41b6-b0fa-d3da8cbfa94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb2c41a-d2d7-4e2a-8800-91fb33ef5def", "name": "network-vif-plugged", "status": "completed", "tag": "2208d25f-6682-4ab4-8ac8-158028b26ee7"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:17.804132 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-32dda319-35e1-47f6-a3ae-744731c0f0fa req-b4f367e6-6b3a-41b6-b0fa-d3da8cbfa94a service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.805289 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-32dda319-35e1-47f6-a3ae-744731c0f0fa req-b4f367e6-6b3a-41b6-b0fa-d3da8cbfa94a service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:17.833927 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-32dda319-35e1-47f6-a3ae-744731c0f0fa req-b4f367e6-6b3a-41b6-b0fa-d3da8cbfa94a service nova] Creating event network-vif-plugged:2208d25f-6682-4ab4-8ac8-158028b26ee7 for instance 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def on hv-cinder-75078 May 16 18:51:17.846714 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-32dda319-35e1-47f6-a3ae-744731c0f0fa req-b4f367e6-6b3a-41b6-b0fa-d3da8cbfa94a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065130 May 16 18:51:17.848611 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 173/352] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:17.861722 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5cfe01c5-72fd-42c5-af94-c481128c190e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:17.863283 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5cfe01c5-72fd-42c5-af94-c481128c190e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:17.875453 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5cfe01c5-72fd-42c5-af94-c481128c190e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.876646 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5cfe01c5-72fd-42c5-af94-c481128c190e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:17.878407 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5cfe01c5-72fd-42c5-af94-c481128c190e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.879826 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5cfe01c5-72fd-42c5-af94-c481128c190e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:17.902524 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0c501236-f524-4a9f-9349-9d682fb1f715 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:17.920684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0c501236-f524-4a9f-9349-9d682fb1f715 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.376233 May 16 18:51:17.923700 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 180/353] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:17 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:17.958405 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6cbf0f33-2122-4486-ba48-da0171bfc638 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:17.959126 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6cbf0f33-2122-4486-ba48-da0171bfc638 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:17.973161 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cbf0f33-2122-4486-ba48-da0171bfc638 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.973988 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cbf0f33-2122-4486-ba48-da0171bfc638 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:17.975140 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cbf0f33-2122-4486-ba48-da0171bfc638 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:17.975657 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6cbf0f33-2122-4486-ba48-da0171bfc638 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:18.422143 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5cfe01c5-72fd-42c5-af94-c481128c190e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:18.446080 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5cfe01c5-72fd-42c5-af94-c481128c190e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.595270 May 16 18:51:18.447367 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 174/354] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:17 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:18.462511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-732e44ce-66b3-4d94-a918-32248d795b98 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:18.473200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-732e44ce-66b3-4d94-a918-32248d795b98 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:18.488948 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6cbf0f33-2122-4486-ba48-da0171bfc638 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:18.492707 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-732e44ce-66b3-4d94-a918-32248d795b98 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:18.493739 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-732e44ce-66b3-4d94-a918-32248d795b98 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:18.495300 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-732e44ce-66b3-4d94-a918-32248d795b98 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:18.499115 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-732e44ce-66b3-4d94-a918-32248d795b98 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:18.505586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6cbf0f33-2122-4486-ba48-da0171bfc638 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1515 microversion: 2.1 time: 0.561760 May 16 18:51:18.507875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 181/355] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:17 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1515 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:18.533526 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-33972e8d-c07a-401a-87fc-8d5d558a9f18 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:18.534543 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-33972e8d-c07a-401a-87fc-8d5d558a9f18 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:18.549404 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-33972e8d-c07a-401a-87fc-8d5d558a9f18 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:18.551983 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-33972e8d-c07a-401a-87fc-8d5d558a9f18 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:18.553309 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-33972e8d-c07a-401a-87fc-8d5d558a9f18 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:18.555125 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-33972e8d-c07a-401a-87fc-8d5d558a9f18 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:19.081604 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-33972e8d-c07a-401a-87fc-8d5d558a9f18 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:19.103973 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-33972e8d-c07a-401a-87fc-8d5d558a9f18 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1314 microversion: 2.1 time: 0.580094 May 16 18:51:19.107993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-732e44ce-66b3-4d94-a918-32248d795b98 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:19.114948 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 182/356] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:18 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:19.132109 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-732e44ce-66b3-4d94-a918-32248d795b98 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.682806 May 16 18:51:19.138060 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b577c64a-54ff-45e2-873c-78cff9cd6ee3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:19.147352 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 175/357] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:18 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:19.149339 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b577c64a-54ff-45e2-873c-78cff9cd6ee3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:19.153634 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-e89e266e-d450-4cfe-b01c-44212f8de7ae req-4045f941-d948-49de-ab97-009def74fb40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12aa2a80-3944-4ff6-9b34-ada2debe18c5", "tag": "fbd9282a-e554-4f50-b165-7ce5f6ec3daa"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:19.169948 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b577c64a-54ff-45e2-873c-78cff9cd6ee3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:19.170604 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b577c64a-54ff-45e2-873c-78cff9cd6ee3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:19.171945 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b577c64a-54ff-45e2-873c-78cff9cd6ee3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:19.173338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b577c64a-54ff-45e2-873c-78cff9cd6ee3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:19.176016 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-e89e266e-d450-4cfe-b01c-44212f8de7ae req-4045f941-d948-49de-ab97-009def74fb40 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:19.179013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-e89e266e-d450-4cfe-b01c-44212f8de7ae req-4045f941-d948-49de-ab97-009def74fb40 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:19.204864 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-e89e266e-d450-4cfe-b01c-44212f8de7ae req-4045f941-d948-49de-ab97-009def74fb40 service nova] Creating event network-changed:fbd9282a-e554-4f50-b165-7ce5f6ec3daa for instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 on hv-cinder-75078 May 16 18:51:19.210716 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-e89e266e-d450-4cfe-b01c-44212f8de7ae req-4045f941-d948-49de-ab97-009def74fb40 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061839 May 16 18:51:19.211808 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 176/358] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:19.217405 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2ba40263-de72-4839-95ce-dd7e4b03364a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:19.218458 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2ba40263-de72-4839-95ce-dd7e4b03364a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:19.237619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2ba40263-de72-4839-95ce-dd7e4b03364a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:19.238348 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2ba40263-de72-4839-95ce-dd7e4b03364a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:19.239343 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2ba40263-de72-4839-95ce-dd7e4b03364a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:19.239985 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2ba40263-de72-4839-95ce-dd7e4b03364a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:19.677588 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b577c64a-54ff-45e2-873c-78cff9cd6ee3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:19.680595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2ba40263-de72-4839-95ce-dd7e4b03364a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:19.701830 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2ba40263-de72-4839-95ce-dd7e4b03364a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.488510 May 16 18:51:19.726049 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 177/359] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:19 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:19.734389 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b577c64a-54ff-45e2-873c-78cff9cd6ee3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:19.741363 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b577c64a-54ff-45e2-873c-78cff9cd6ee3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:19.743807 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b577c64a-54ff-45e2-873c-78cff9cd6ee3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.621730 May 16 18:51:19.745719 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-7cd8e9eb-3acf-4baa-83bc-68f6be1cabab req-ea069007-a943-44e5-aadf-5fe228adda81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6715a3-0274-463c-b6e5-4116112ef2c9", "tag": "e2de6415-3434-48d3-a9f3-46de3d297b6e"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:19.746554 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 183/360] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:19 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:19.773656 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-46fcdf79-313d-422f-948a-ae2f4823143e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:19.774287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-46fcdf79-313d-422f-948a-ae2f4823143e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:19.775861 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-7cd8e9eb-3acf-4baa-83bc-68f6be1cabab req-ea069007-a943-44e5-aadf-5fe228adda81 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:19.776699 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-7cd8e9eb-3acf-4baa-83bc-68f6be1cabab req-ea069007-a943-44e5-aadf-5fe228adda81 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:19.792613 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46fcdf79-313d-422f-948a-ae2f4823143e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:19.793075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46fcdf79-313d-422f-948a-ae2f4823143e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:19.793895 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46fcdf79-313d-422f-948a-ae2f4823143e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:19.794340 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46fcdf79-313d-422f-948a-ae2f4823143e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:19.847146 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-7cd8e9eb-3acf-4baa-83bc-68f6be1cabab req-ea069007-a943-44e5-aadf-5fe228adda81 service nova] Creating event network-changed:e2de6415-3434-48d3-a9f3-46de3d297b6e for instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 on hv-cinder-75078 May 16 18:51:19.855858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-7cd8e9eb-3acf-4baa-83bc-68f6be1cabab req-ea069007-a943-44e5-aadf-5fe228adda81 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123195 May 16 18:51:19.857790 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 178/361] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:20.125555 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-46fcdf79-313d-422f-948a-ae2f4823143e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:20.133700 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-49202b6d-fdad-4e2a-b497-15fee5935b50 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:20.135039 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-49202b6d-fdad-4e2a-b497-15fee5935b50 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:20.144684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-46fcdf79-313d-422f-948a-ae2f4823143e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.383276 May 16 18:51:20.160208 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 184/362] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:19 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:20.163348 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49202b6d-fdad-4e2a-b497-15fee5935b50 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:20.164074 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49202b6d-fdad-4e2a-b497-15fee5935b50 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:20.165163 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49202b6d-fdad-4e2a-b497-15fee5935b50 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:20.165778 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49202b6d-fdad-4e2a-b497-15fee5935b50 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:20.167346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-33c22cd4-6c04-4c43-ae22-7e866aa9d1de tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:20.168339 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-33c22cd4-6c04-4c43-ae22-7e866aa9d1de tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:20.177054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-33c22cd4-6c04-4c43-ae22-7e866aa9d1de tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:20.177751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-33c22cd4-6c04-4c43-ae22-7e866aa9d1de tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:20.186355 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-33c22cd4-6c04-4c43-ae22-7e866aa9d1de tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:20.188532 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-33c22cd4-6c04-4c43-ae22-7e866aa9d1de tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:20.484918 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-33c22cd4-6c04-4c43-ae22-7e866aa9d1de tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:20.498010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-33c22cd4-6c04-4c43-ae22-7e866aa9d1de tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.336313 May 16 18:51:20.501532 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 185/363] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:20 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:20.595738 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-49202b6d-fdad-4e2a-b497-15fee5935b50 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:20.608386 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-49202b6d-fdad-4e2a-b497-15fee5935b50 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1314 microversion: 2.1 time: 0.479832 May 16 18:51:20.610575 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 179/364] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:20 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:20.661903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b5560f46-fa1c-446a-a34b-fd658137ef16 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:20.663041 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b5560f46-fa1c-446a-a34b-fd658137ef16 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:20.670036 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b5560f46-fa1c-446a-a34b-fd658137ef16 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:20.670576 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b5560f46-fa1c-446a-a34b-fd658137ef16 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:20.671440 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b5560f46-fa1c-446a-a34b-fd658137ef16 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:20.672167 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b5560f46-fa1c-446a-a34b-fd658137ef16 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:20.703273 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-b5560f46-fa1c-446a-a34b-fd658137ef16 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lazy-loading 'flavor' on Instance uuid a2573d57-ebb1-4daf-8809-cdc7c0d32eac {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:51:20.754717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2c523512-fa00-41b8-9ea0-2eda4d168238 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:20.756037 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2c523512-fa00-41b8-9ea0-2eda4d168238 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:20.765690 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c523512-fa00-41b8-9ea0-2eda4d168238 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:20.766920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c523512-fa00-41b8-9ea0-2eda4d168238 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:20.769264 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c523512-fa00-41b8-9ea0-2eda4d168238 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:20.770305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c523512-fa00-41b8-9ea0-2eda4d168238 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:20.894577 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b5560f46-fa1c-446a-a34b-fd658137ef16 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac/action" status: 200 len: 32 microversion: 2.1 time: 0.236074 May 16 18:51:20.899873 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 186/365] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:51:20 2022] POST /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac/action => generated 32 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 18:51:20.917145 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f4fb7efb-247f-4cc6-a79f-74e602f69bbb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:20.920559 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f4fb7efb-247f-4cc6-a79f-74e602f69bbb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:20.931798 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f4fb7efb-247f-4cc6-a79f-74e602f69bbb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:20.932578 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f4fb7efb-247f-4cc6-a79f-74e602f69bbb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:20.935803 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f4fb7efb-247f-4cc6-a79f-74e602f69bbb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:20.936815 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f4fb7efb-247f-4cc6-a79f-74e602f69bbb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:21.006338 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2c523512-fa00-41b8-9ea0-2eda4d168238 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:21.030810 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2c523512-fa00-41b8-9ea0-2eda4d168238 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.283434 May 16 18:51:21.032985 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 180/366] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:20 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:21.060128 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d2bbd011-8c01-4835-b9e5-e6b1d49b61e1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:21.080069 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d2bbd011-8c01-4835-b9e5-e6b1d49b61e1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:21.096366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d2bbd011-8c01-4835-b9e5-e6b1d49b61e1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:21.097138 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d2bbd011-8c01-4835-b9e5-e6b1d49b61e1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:21.098178 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d2bbd011-8c01-4835-b9e5-e6b1d49b61e1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:21.098845 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d2bbd011-8c01-4835-b9e5-e6b1d49b61e1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:21.302435 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f4fb7efb-247f-4cc6-a79f-74e602f69bbb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:21.313777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f4fb7efb-247f-4cc6-a79f-74e602f69bbb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:21.316856 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f4fb7efb-247f-4cc6-a79f-74e602f69bbb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:21.318872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f4fb7efb-247f-4cc6-a79f-74e602f69bbb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.408588 May 16 18:51:21.320908 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 187/367] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:20 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:21.330522 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5538cafc-b6bc-4d11-a19c-538dee626658 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:21.331474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5538cafc-b6bc-4d11-a19c-538dee626658 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:21.344740 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5538cafc-b6bc-4d11-a19c-538dee626658 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:21.345684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5538cafc-b6bc-4d11-a19c-538dee626658 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:21.347362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5538cafc-b6bc-4d11-a19c-538dee626658 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:21.349484 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5538cafc-b6bc-4d11-a19c-538dee626658 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:21.424560 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d2bbd011-8c01-4835-b9e5-e6b1d49b61e1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:21.460217 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d2bbd011-8c01-4835-b9e5-e6b1d49b61e1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.419927 May 16 18:51:21.467823 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 181/368] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:21 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:21.524381 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-332b470f-f25a-4e04-90d1-c8ef7a3364bc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:21.525937 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-332b470f-f25a-4e04-90d1-c8ef7a3364bc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:21.539931 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-332b470f-f25a-4e04-90d1-c8ef7a3364bc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:21.541084 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-332b470f-f25a-4e04-90d1-c8ef7a3364bc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:21.543581 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-332b470f-f25a-4e04-90d1-c8ef7a3364bc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:21.545057 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-332b470f-f25a-4e04-90d1-c8ef7a3364bc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:21.838597 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5538cafc-b6bc-4d11-a19c-538dee626658 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:21.861352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5538cafc-b6bc-4d11-a19c-538dee626658 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.538692 May 16 18:51:21.867867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 188/369] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:21 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:21.883378 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4dae2390-fe0b-4c1f-9167-c95920e3fc3c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:21.884746 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-4dae2390-fe0b-4c1f-9167-c95920e3fc3c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:21.896703 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4dae2390-fe0b-4c1f-9167-c95920e3fc3c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:21.897705 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4dae2390-fe0b-4c1f-9167-c95920e3fc3c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:21.899429 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4dae2390-fe0b-4c1f-9167-c95920e3fc3c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:21.900585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4dae2390-fe0b-4c1f-9167-c95920e3fc3c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:21.942653 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-332b470f-f25a-4e04-90d1-c8ef7a3364bc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:21.955457 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-332b470f-f25a-4e04-90d1-c8ef7a3364bc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.442110 May 16 18:51:21.956339 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 182/370] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:21 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:22.387625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-4dae2390-fe0b-4c1f-9167-c95920e3fc3c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:22.404482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-4dae2390-fe0b-4c1f-9167-c95920e3fc3c tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1497 microversion: 2.1 time: 0.534629 May 16 18:51:22.405004 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 189/371] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:21 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1497 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:22.411684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a2afd3f1-4143-48c6-b991-b11560615eae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:22.422269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a2afd3f1-4143-48c6-b991-b11560615eae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:22.444323 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a2afd3f1-4143-48c6-b991-b11560615eae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:22.444674 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a2afd3f1-4143-48c6-b991-b11560615eae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:22.445541 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a2afd3f1-4143-48c6-b991-b11560615eae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:22.446012 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a2afd3f1-4143-48c6-b991-b11560615eae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:22.457424 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8ca6a326-0d2c-4ea7-ace1-2ef5cd3f2cb2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Action: 'create', calling method: .version_select at 0x7f6468742b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-426666422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2L2itSrZZS2uRh5QD8jyVo8tqfqGjSxGf7tm8vub7CGHFxNRTnTsvF1W1sjzkLWDn7pNqb5ejfdiKiEU0HIedg0WMAxYCw8c2VUnUFf/x0kciE9R3qjY3U0kgRhl98Mw=="}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:22.500727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-8ca6a326-0d2c-4ea7-ace1-2ef5cd3f2cb2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Getting quotas for project 5b168bfd42a645269b47c98f4210e4aa. Resources: {'key_pairs'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:51:22.515359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-8ca6a326-0d2c-4ea7-ace1-2ef5cd3f2cb2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Getting quotas for user 5e9ebfaac4984817bb768476ef74445c and project 5b168bfd42a645269b47c98f4210e4aa. Resources: {'key_pairs'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:51:22.604245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8ca6a326-0d2c-4ea7-ace1-2ef5cd3f2cb2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.646102 May 16 18:51:22.607121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 183/372] 10.222.0.72 () {60 vars in 1158 bytes} [Mon May 16 18:51:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:22.630985 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3206c9cf-b86b-4b77-851c-2d4faf9782bb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:22.632925 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-3206c9cf-b86b-4b77-851c-2d4faf9782bb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:22.645884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3206c9cf-b86b-4b77-851c-2d4faf9782bb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:22.646813 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3206c9cf-b86b-4b77-851c-2d4faf9782bb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:22.648081 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3206c9cf-b86b-4b77-851c-2d4faf9782bb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:22.649101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3206c9cf-b86b-4b77-851c-2d4faf9782bb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:22.883886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a2afd3f1-4143-48c6-b991-b11560615eae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:22.909115 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-3206c9cf-b86b-4b77-851c-2d4faf9782bb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:22.925592 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-3206c9cf-b86b-4b77-851c-2d4faf9782bb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:22.928252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-3206c9cf-b86b-4b77-851c-2d4faf9782bb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:22.930178 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3206c9cf-b86b-4b77-851c-2d4faf9782bb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1744 microversion: 2.20 time: 0.319141 May 16 18:51:22.945860 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 184/373] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:22 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1744 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:22.947060 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a2afd3f1-4143-48c6-b991-b11560615eae tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.527635 May 16 18:51:22.947060 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 190/374] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:22 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:22.947343 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-bda74cc1-2953-49d0-a98c-0cc8743d8ce0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:22.947644 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-bda74cc1-2953-49d0-a98c-0cc8743d8ce0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:22.957585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f8147eb6-a52d-4435-af62-41b06491313c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:22.960978 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f8147eb6-a52d-4435-af62-41b06491313c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:22.970173 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bda74cc1-2953-49d0-a98c-0cc8743d8ce0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:22.971049 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bda74cc1-2953-49d0-a98c-0cc8743d8ce0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:22.972488 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bda74cc1-2953-49d0-a98c-0cc8743d8ce0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:22.973381 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bda74cc1-2953-49d0-a98c-0cc8743d8ce0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:23.004956 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f8147eb6-a52d-4435-af62-41b06491313c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:23.007350 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f8147eb6-a52d-4435-af62-41b06491313c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:23.010283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f8147eb6-a52d-4435-af62-41b06491313c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:23.012524 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f8147eb6-a52d-4435-af62-41b06491313c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:23.648587 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bda74cc1-2953-49d0-a98c-0cc8743d8ce0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:23.668448 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-bda74cc1-2953-49d0-a98c-0cc8743d8ce0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.734306 May 16 18:51:23.671197 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 185/375] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:22 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:23.672787 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f8147eb6-a52d-4435-af62-41b06491313c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:23.680939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2f9022a0-05bf-439d-b63b-b8963297db3a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:23.682485 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2f9022a0-05bf-439d-b63b-b8963297db3a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:23.695449 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2f9022a0-05bf-439d-b63b-b8963297db3a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:23.696609 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2f9022a0-05bf-439d-b63b-b8963297db3a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:23.698000 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2f9022a0-05bf-439d-b63b-b8963297db3a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:23.698448 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2f9022a0-05bf-439d-b63b-b8963297db3a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:23.709228 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f8147eb6-a52d-4435-af62-41b06491313c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.769693 May 16 18:51:23.711309 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 191/376] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:22 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:23.719100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0a9c086a-fa47-4c69-9637-66bee88c3b7a tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:23.719596 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0a9c086a-fa47-4c69-9637-66bee88c3b7a tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:23.733720 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a9c086a-fa47-4c69-9637-66bee88c3b7a tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:23.734294 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a9c086a-fa47-4c69-9637-66bee88c3b7a tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:23.735437 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a9c086a-fa47-4c69-9637-66bee88c3b7a tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:23.736574 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a9c086a-fa47-4c69-9637-66bee88c3b7a tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:23.807840 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0a9c086a-fa47-4c69-9637-66bee88c3b7a tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Going to try to terminate instance {{(pid=128886) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:51:23.929541 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0a9c086a-fa47-4c69-9637-66bee88c3b7a tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 204 len: 0 microversion: 2.1 time: 0.215560 May 16 18:51:23.936879 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 192/377] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:51:23 2022] DELETE /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:51:23.942512 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c270a7c1-190a-4c25-ba6d-9a399abd1b91 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:23.943207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c270a7c1-190a-4c25-ba6d-9a399abd1b91 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:23.957064 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c270a7c1-190a-4c25-ba6d-9a399abd1b91 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:23.958113 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c270a7c1-190a-4c25-ba6d-9a399abd1b91 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:23.959212 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c270a7c1-190a-4c25-ba6d-9a399abd1b91 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:23.960014 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c270a7c1-190a-4c25-ba6d-9a399abd1b91 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:24.056353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2f9022a0-05bf-439d-b63b-b8963297db3a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:24.083613 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2f9022a0-05bf-439d-b63b-b8963297db3a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.410346 May 16 18:51:24.091354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 186/378] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:23 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:24.104049 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4694a8b8-07bf-40c3-83e3-8a18388afee0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:24.114567 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4694a8b8-07bf-40c3-83e3-8a18388afee0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:24.144147 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4694a8b8-07bf-40c3-83e3-8a18388afee0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:24.146516 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4694a8b8-07bf-40c3-83e3-8a18388afee0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:24.148574 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4694a8b8-07bf-40c3-83e3-8a18388afee0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:24.149520 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4694a8b8-07bf-40c3-83e3-8a18388afee0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:24.314231 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c270a7c1-190a-4c25-ba6d-9a399abd1b91 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:24.346439 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c270a7c1-190a-4c25-ba6d-9a399abd1b91 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1503 microversion: 2.1 time: 0.407717 May 16 18:51:24.347771 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 193/379] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:23 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:24.354432 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1608fe9d-747a-49f0-8279-3ae6d8f62f69 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:24.355597 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1608fe9d-747a-49f0-8279-3ae6d8f62f69 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:24.374228 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1608fe9d-747a-49f0-8279-3ae6d8f62f69 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:24.379815 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1608fe9d-747a-49f0-8279-3ae6d8f62f69 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:24.381172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1608fe9d-747a-49f0-8279-3ae6d8f62f69 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:24.381942 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1608fe9d-747a-49f0-8279-3ae6d8f62f69 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:24.546108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4694a8b8-07bf-40c3-83e3-8a18388afee0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:24.573926 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4694a8b8-07bf-40c3-83e3-8a18388afee0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.474380 May 16 18:51:24.581899 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 187/380] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:24 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:24.697816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ebf71155-5092-4dae-9d30-5fdb01706130 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:24.705529 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ebf71155-5092-4dae-9d30-5fdb01706130 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:24.728080 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ebf71155-5092-4dae-9d30-5fdb01706130 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:24.730301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ebf71155-5092-4dae-9d30-5fdb01706130 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:24.731774 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ebf71155-5092-4dae-9d30-5fdb01706130 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:24.735939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ebf71155-5092-4dae-9d30-5fdb01706130 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:24.907329 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1608fe9d-747a-49f0-8279-3ae6d8f62f69 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:24.930778 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1608fe9d-747a-49f0-8279-3ae6d8f62f69 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:24.935986 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1608fe9d-747a-49f0-8279-3ae6d8f62f69 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:24.941417 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1608fe9d-747a-49f0-8279-3ae6d8f62f69 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1744 microversion: 2.20 time: 0.591325 May 16 18:51:24.941991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 194/381] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:24 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1744 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:24.951306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7be92797-4424-4931-ab24-c209c7fdc990 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:24.953936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7be92797-4424-4931-ab24-c209c7fdc990 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:24.964625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7be92797-4424-4931-ab24-c209c7fdc990 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:24.966177 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7be92797-4424-4931-ab24-c209c7fdc990 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:24.969749 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7be92797-4424-4931-ab24-c209c7fdc990 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:24.972011 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7be92797-4424-4931-ab24-c209c7fdc990 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:24.997772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ebf71155-5092-4dae-9d30-5fdb01706130 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:25.010313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ebf71155-5092-4dae-9d30-5fdb01706130 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.320029 May 16 18:51:25.012311 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 188/382] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:24 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:25.115963 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4ff8a92a-01f4-4518-a467-c4a9e76d1b8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:25.117671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4ff8a92a-01f4-4518-a467-c4a9e76d1b8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:25.130107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ff8a92a-01f4-4518-a467-c4a9e76d1b8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:25.130821 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ff8a92a-01f4-4518-a467-c4a9e76d1b8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:25.132027 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ff8a92a-01f4-4518-a467-c4a9e76d1b8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:25.132999 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ff8a92a-01f4-4518-a467-c4a9e76d1b8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:25.279136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7be92797-4424-4931-ab24-c209c7fdc990 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:25.301888 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7be92797-4424-4931-ab24-c209c7fdc990 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.354000 May 16 18:51:25.302595 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 195/383] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:24 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:25.379866 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-689eed90-fb0f-4e81-a856-3a747d13e90b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:25.382264 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-689eed90-fb0f-4e81-a856-3a747d13e90b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:25.394344 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-689eed90-fb0f-4e81-a856-3a747d13e90b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:25.395082 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-689eed90-fb0f-4e81-a856-3a747d13e90b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:25.397989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-689eed90-fb0f-4e81-a856-3a747d13e90b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:25.399107 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-689eed90-fb0f-4e81-a856-3a747d13e90b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:25.419115 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4ff8a92a-01f4-4518-a467-c4a9e76d1b8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:25.434999 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4ff8a92a-01f4-4518-a467-c4a9e76d1b8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.327029 May 16 18:51:25.437014 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 189/384] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:25 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:25.565271 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-8a702633-bdbd-464a-a9e6-4c0a0ae2118c req-e2e0efd6-c51c-470c-aee4-b377ce1466e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de1432f-5419-4150-84a0-0fe456962ce9", "name": "network-vif-plugged", "status": "completed", "tag": "eeb3fe2b-d9aa-4852-85f0-2e9f90328234"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:25.584406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-8a702633-bdbd-464a-a9e6-4c0a0ae2118c req-e2e0efd6-c51c-470c-aee4-b377ce1466e4 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:25.585129 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-8a702633-bdbd-464a-a9e6-4c0a0ae2118c req-e2e0efd6-c51c-470c-aee4-b377ce1466e4 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:25.606708 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-8a702633-bdbd-464a-a9e6-4c0a0ae2118c req-e2e0efd6-c51c-470c-aee4-b377ce1466e4 service nova] Creating event network-vif-plugged:eeb3fe2b-d9aa-4852-85f0-2e9f90328234 for instance 4de1432f-5419-4150-84a0-0fe456962ce9 on hv-cinder-75078 May 16 18:51:25.648291 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-8a702633-bdbd-464a-a9e6-4c0a0ae2118c req-e2e0efd6-c51c-470c-aee4-b377ce1466e4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068213 May 16 18:51:25.650698 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 190/385] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:51:25.659272 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-064f2118-f03e-49ee-9dbb-fd9239d630c2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:25.660279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-064f2118-f03e-49ee-9dbb-fd9239d630c2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:25.668299 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-064f2118-f03e-49ee-9dbb-fd9239d630c2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:25.668945 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-064f2118-f03e-49ee-9dbb-fd9239d630c2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:25.669909 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-064f2118-f03e-49ee-9dbb-fd9239d630c2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:25.670498 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-064f2118-f03e-49ee-9dbb-fd9239d630c2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:25.840765 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-689eed90-fb0f-4e81-a856-3a747d13e90b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:25.856398 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-689eed90-fb0f-4e81-a856-3a747d13e90b tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1503 microversion: 2.1 time: 0.485596 May 16 18:51:25.857909 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 196/386] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:25 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1503 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:25.951144 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-064f2118-f03e-49ee-9dbb-fd9239d630c2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:25.976601 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-889aa083-1c83-4e20-95eb-751c1a217762 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:25.979067 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-889aa083-1c83-4e20-95eb-751c1a217762 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:25.988086 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-064f2118-f03e-49ee-9dbb-fd9239d630c2 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.335505 May 16 18:51:26.004289 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 191/387] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:25 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:26.004470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-889aa083-1c83-4e20-95eb-751c1a217762 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:26.004470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-889aa083-1c83-4e20-95eb-751c1a217762 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:26.004470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-889aa083-1c83-4e20-95eb-751c1a217762 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:26.004470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-889aa083-1c83-4e20-95eb-751c1a217762 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:26.039393 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-cfccca64-a5c1-4370-8b6d-ce818a831647 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:26.051812 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-cfccca64-a5c1-4370-8b6d-ce818a831647 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:26.069979 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cfccca64-a5c1-4370-8b6d-ce818a831647 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:26.071114 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cfccca64-a5c1-4370-8b6d-ce818a831647 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:26.072881 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cfccca64-a5c1-4370-8b6d-ce818a831647 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:26.073901 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cfccca64-a5c1-4370-8b6d-ce818a831647 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:26.336856 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-889aa083-1c83-4e20-95eb-751c1a217762 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:26.377482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-889aa083-1c83-4e20-95eb-751c1a217762 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:26.380818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-889aa083-1c83-4e20-95eb-751c1a217762 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:26.383360 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-889aa083-1c83-4e20-95eb-751c1a217762 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1744 microversion: 2.20 time: 0.415142 May 16 18:51:26.384476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 197/388] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:25 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1744 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:51:26.394648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-64bc68f3-8456-4cc1-a173-01dd1f5db108 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:26.395961 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-cfccca64-a5c1-4370-8b6d-ce818a831647 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:26.396526 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-64bc68f3-8456-4cc1-a173-01dd1f5db108 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:26.412408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-cfccca64-a5c1-4370-8b6d-ce818a831647 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.380848 May 16 18:51:26.413644 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64bc68f3-8456-4cc1-a173-01dd1f5db108 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:26.415424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64bc68f3-8456-4cc1-a173-01dd1f5db108 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:26.417185 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 192/389] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:26 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:26.417475 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64bc68f3-8456-4cc1-a173-01dd1f5db108 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:26.418314 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64bc68f3-8456-4cc1-a173-01dd1f5db108 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:26.460574 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0745c43e-830f-44f4-a557-073574f594e4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:26.462379 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0745c43e-830f-44f4-a557-073574f594e4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:26.473473 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0745c43e-830f-44f4-a557-073574f594e4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:26.474390 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0745c43e-830f-44f4-a557-073574f594e4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:26.476044 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0745c43e-830f-44f4-a557-073574f594e4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:26.477196 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0745c43e-830f-44f4-a557-073574f594e4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:26.930043 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-64bc68f3-8456-4cc1-a173-01dd1f5db108 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:26.941408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0745c43e-830f-44f4-a557-073574f594e4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:26.946534 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-64bc68f3-8456-4cc1-a173-01dd1f5db108 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.560373 May 16 18:51:26.949557 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 198/390] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:26 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:26.956920 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-09b29936-7489-46a7-91a7-7e21e5f5d1af tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:26.957790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-09b29936-7489-46a7-91a7-7e21e5f5d1af tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:26.961834 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0745c43e-830f-44f4-a557-073574f594e4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.509073 May 16 18:51:26.972543 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 193/391] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:26 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:26.980752 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-09b29936-7489-46a7-91a7-7e21e5f5d1af tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:26.981882 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-09b29936-7489-46a7-91a7-7e21e5f5d1af tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:26.982936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-09b29936-7489-46a7-91a7-7e21e5f5d1af tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:26.983594 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-09b29936-7489-46a7-91a7-7e21e5f5d1af tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:27.015103 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f05a5eb3-1415-47e6-9851-94da9e2dee6e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:27.017806 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f05a5eb3-1415-47e6-9851-94da9e2dee6e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:27.031388 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f05a5eb3-1415-47e6-9851-94da9e2dee6e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:27.033041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f05a5eb3-1415-47e6-9851-94da9e2dee6e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:27.034122 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f05a5eb3-1415-47e6-9851-94da9e2dee6e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:27.034732 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f05a5eb3-1415-47e6-9851-94da9e2dee6e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:27.364871 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-09b29936-7489-46a7-91a7-7e21e5f5d1af tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:27.396145 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-09b29936-7489-46a7-91a7-7e21e5f5d1af tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1503 microversion: 2.1 time: 0.437696 May 16 18:51:27.399790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 199/392] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:26 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1503 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:27.416189 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c6c61686-2201-4508-b89d-6edf35d1709d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:27.416960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c6c61686-2201-4508-b89d-6edf35d1709d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:27.433867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c6c61686-2201-4508-b89d-6edf35d1709d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:27.434769 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c6c61686-2201-4508-b89d-6edf35d1709d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:27.436350 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c6c61686-2201-4508-b89d-6edf35d1709d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:27.437816 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c6c61686-2201-4508-b89d-6edf35d1709d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:27.457403 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f05a5eb3-1415-47e6-9851-94da9e2dee6e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:27.472030 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f05a5eb3-1415-47e6-9851-94da9e2dee6e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.460371 May 16 18:51:27.473157 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 194/393] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:27 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:27.480596 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d1153397-26b2-4810-a102-617a482565fa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:27.481550 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d1153397-26b2-4810-a102-617a482565fa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:27.491101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1153397-26b2-4810-a102-617a482565fa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:27.492256 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1153397-26b2-4810-a102-617a482565fa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:27.493924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1153397-26b2-4810-a102-617a482565fa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:27.495034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1153397-26b2-4810-a102-617a482565fa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:27.768782 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c6c61686-2201-4508-b89d-6edf35d1709d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:27.776823 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d1153397-26b2-4810-a102-617a482565fa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:27.791424 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d1153397-26b2-4810-a102-617a482565fa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.316483 May 16 18:51:27.801806 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c6c61686-2201-4508-b89d-6edf35d1709d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:27.802276 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 195/394] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:27 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:27.805994 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c6c61686-2201-4508-b89d-6edf35d1709d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:27.808637 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c6c61686-2201-4508-b89d-6edf35d1709d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.399134 May 16 18:51:27.809917 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 200/395] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:27 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:51:27.973304 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-238eed52-4a78-4981-9c43-31c5fbd2076f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:27.974016 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-238eed52-4a78-4981-9c43-31c5fbd2076f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:27.983523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-238eed52-4a78-4981-9c43-31c5fbd2076f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:27.984760 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-238eed52-4a78-4981-9c43-31c5fbd2076f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:27.985065 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ce09edd9-3bfc-47c8-9456-9a4152272bc6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:27.986112 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-238eed52-4a78-4981-9c43-31c5fbd2076f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:27.986315 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ce09edd9-3bfc-47c8-9456-9a4152272bc6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:27.986829 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-238eed52-4a78-4981-9c43-31c5fbd2076f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:27.995701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ce09edd9-3bfc-47c8-9456-9a4152272bc6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:27.996340 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ce09edd9-3bfc-47c8-9456-9a4152272bc6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:27.997258 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ce09edd9-3bfc-47c8-9456-9a4152272bc6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:27.997802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ce09edd9-3bfc-47c8-9456-9a4152272bc6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:28.225071 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ce09edd9-3bfc-47c8-9456-9a4152272bc6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:28.235960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ce09edd9-3bfc-47c8-9456-9a4152272bc6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.258086 May 16 18:51:28.237030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 201/396] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:27 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:28.241346 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-238eed52-4a78-4981-9c43-31c5fbd2076f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:28.250205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-238eed52-4a78-4981-9c43-31c5fbd2076f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.282211 May 16 18:51:28.250810 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 196/397] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:27 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:28.424874 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2c5fac0a-ff45-48a9-be82-5ab8fc838490 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:28.425989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2c5fac0a-ff45-48a9-be82-5ab8fc838490 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:28.435975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2c5fac0a-ff45-48a9-be82-5ab8fc838490 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:28.436723 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2c5fac0a-ff45-48a9-be82-5ab8fc838490 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:28.438418 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2c5fac0a-ff45-48a9-be82-5ab8fc838490 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:28.439180 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2c5fac0a-ff45-48a9-be82-5ab8fc838490 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:28.491552 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-78a9d8fc-1835-45ae-a072-e5941b1baf1b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:28.492336 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-78a9d8fc-1835-45ae-a072-e5941b1baf1b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:28.499459 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78a9d8fc-1835-45ae-a072-e5941b1baf1b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:28.500137 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78a9d8fc-1835-45ae-a072-e5941b1baf1b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:28.501186 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78a9d8fc-1835-45ae-a072-e5941b1baf1b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:28.501819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78a9d8fc-1835-45ae-a072-e5941b1baf1b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:28.743311 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2c5fac0a-ff45-48a9-be82-5ab8fc838490 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:28.769720 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2c5fac0a-ff45-48a9-be82-5ab8fc838490 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1503 microversion: 2.1 time: 0.351387 May 16 18:51:28.772409 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 202/398] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:28 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:28.827223 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-52e1dfa8-cc55-489f-b299-c74b9cc50f1b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:28.831864 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-52e1dfa8-cc55-489f-b299-c74b9cc50f1b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:28.839687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-52e1dfa8-cc55-489f-b299-c74b9cc50f1b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:28.840198 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-52e1dfa8-cc55-489f-b299-c74b9cc50f1b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:28.841028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-52e1dfa8-cc55-489f-b299-c74b9cc50f1b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:28.856496 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-52e1dfa8-cc55-489f-b299-c74b9cc50f1b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:28.895450 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-78a9d8fc-1835-45ae-a072-e5941b1baf1b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:28.908932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-78a9d8fc-1835-45ae-a072-e5941b1baf1b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.421464 May 16 18:51:28.909869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 197/399] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:28 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:28.944986 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-fd9d2ae5-1cca-4688-9e48-2620df09eecb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:28.946437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-fd9d2ae5-1cca-4688-9e48-2620df09eecb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:28.962614 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fd9d2ae5-1cca-4688-9e48-2620df09eecb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:28.964518 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fd9d2ae5-1cca-4688-9e48-2620df09eecb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:28.966787 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fd9d2ae5-1cca-4688-9e48-2620df09eecb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:28.968699 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fd9d2ae5-1cca-4688-9e48-2620df09eecb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:29.496388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-52e1dfa8-cc55-489f-b299-c74b9cc50f1b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:29.525921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-52e1dfa8-cc55-489f-b299-c74b9cc50f1b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.718207 May 16 18:51:29.545421 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 203/400] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:28 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:29.554663 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-cf22a3df-b62a-4898-8d8c-a547c5cb679b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:29.556923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-cf22a3df-b62a-4898-8d8c-a547c5cb679b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:29.565511 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cf22a3df-b62a-4898-8d8c-a547c5cb679b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:29.566005 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cf22a3df-b62a-4898-8d8c-a547c5cb679b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:29.570185 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cf22a3df-b62a-4898-8d8c-a547c5cb679b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:29.570680 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cf22a3df-b62a-4898-8d8c-a547c5cb679b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:29.859476 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fd9d2ae5-1cca-4688-9e48-2620df09eecb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:29.870804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fd9d2ae5-1cca-4688-9e48-2620df09eecb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:29.872483 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fd9d2ae5-1cca-4688-9e48-2620df09eecb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:29.873716 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-fd9d2ae5-1cca-4688-9e48-2620df09eecb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.946912 May 16 18:51:29.874288 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 198/401] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:28 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:29.880093 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-780b8a86-df48-44ba-89bf-c747b9c4e97e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:29.880996 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-780b8a86-df48-44ba-89bf-c747b9c4e97e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:29.888061 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-780b8a86-df48-44ba-89bf-c747b9c4e97e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:29.891028 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-780b8a86-df48-44ba-89bf-c747b9c4e97e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:29.893449 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-780b8a86-df48-44ba-89bf-c747b9c4e97e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:29.894103 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-780b8a86-df48-44ba-89bf-c747b9c4e97e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:30.184346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cf22a3df-b62a-4898-8d8c-a547c5cb679b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:30.216619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-cf22a3df-b62a-4898-8d8c-a547c5cb679b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.669686 May 16 18:51:30.220284 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 204/402] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:29 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:30.226525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-6e3a7b9f-cd02-4560-9bb5-d14a6b79d4a0 req-ca9ec8d6-b518-4fb6-b97f-3de00706935e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6715a3-0274-463c-b6e5-4116112ef2c9", "name": "network-vif-plugged", "status": "completed", "tag": "e2de6415-3434-48d3-a9f3-46de3d297b6e"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:30.241674 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-6e3a7b9f-cd02-4560-9bb5-d14a6b79d4a0 req-ca9ec8d6-b518-4fb6-b97f-3de00706935e service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:30.242422 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-6e3a7b9f-cd02-4560-9bb5-d14a6b79d4a0 req-ca9ec8d6-b518-4fb6-b97f-3de00706935e service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:30.273662 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-6e3a7b9f-cd02-4560-9bb5-d14a6b79d4a0 req-ca9ec8d6-b518-4fb6-b97f-3de00706935e service nova] Creating event network-vif-plugged:e2de6415-3434-48d3-a9f3-46de3d297b6e for instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 on hv-cinder-75078 May 16 18:51:30.288352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-6e3a7b9f-cd02-4560-9bb5-d14a6b79d4a0 req-ca9ec8d6-b518-4fb6-b97f-3de00706935e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065222 May 16 18:51:30.289434 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 205/403] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:30.300562 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d030d568-01f7-4c90-b11d-55633d8970d7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:30.311050 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d030d568-01f7-4c90-b11d-55633d8970d7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:30.340088 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d030d568-01f7-4c90-b11d-55633d8970d7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:30.340918 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d030d568-01f7-4c90-b11d-55633d8970d7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:30.344915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d030d568-01f7-4c90-b11d-55633d8970d7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:30.345772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d030d568-01f7-4c90-b11d-55633d8970d7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:30.365439 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-780b8a86-df48-44ba-89bf-c747b9c4e97e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:30.390114 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-780b8a86-df48-44ba-89bf-c747b9c4e97e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.512828 May 16 18:51:30.394727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 199/404] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:29 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:30.402212 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1ad2be60-4c62-4e3e-a7ee-ec13153e443f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:30.406892 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1ad2be60-4c62-4e3e-a7ee-ec13153e443f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:30.416790 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1ad2be60-4c62-4e3e-a7ee-ec13153e443f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:30.417527 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1ad2be60-4c62-4e3e-a7ee-ec13153e443f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:30.418780 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1ad2be60-4c62-4e3e-a7ee-ec13153e443f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:30.419406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1ad2be60-4c62-4e3e-a7ee-ec13153e443f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:30.461909 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d030d568-01f7-4c90-b11d-55633d8970d7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2178471fe6400ea4db132f72bc334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:30.485073 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d030d568-01f7-4c90-b11d-55633d8970d7 tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 200 len: 1299 microversion: 2.1 time: 0.192289 May 16 18:51:30.486756 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 206/405] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:30 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 1299 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:30.496937 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-282b3260-6b32-465c-96c9-b3de87396138 req-12370188-89fd-4c8f-b8ec-c8916d330217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb2c41a-d2d7-4e2a-8800-91fb33ef5def", "name": "network-vif-deleted", "tag": "2208d25f-6682-4ab4-8ac8-158028b26ee7"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:30.540391 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-282b3260-6b32-465c-96c9-b3de87396138 req-12370188-89fd-4c8f-b8ec-c8916d330217 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:30.540942 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-282b3260-6b32-465c-96c9-b3de87396138 req-12370188-89fd-4c8f-b8ec-c8916d330217 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:30.586426 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-282b3260-6b32-465c-96c9-b3de87396138 req-12370188-89fd-4c8f-b8ec-c8916d330217 service nova] Creating event network-vif-deleted:2208d25f-6682-4ab4-8ac8-158028b26ee7 for instance 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def on hv-cinder-75078 May 16 18:51:30.622469 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-282b3260-6b32-465c-96c9-b3de87396138 req-12370188-89fd-4c8f-b8ec-c8916d330217 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132733 May 16 18:51:30.627160 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 207/406] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:30.641380 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0e20cc96-aaea-4011-bb4c-51d131175580 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:30.642941 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0e20cc96-aaea-4011-bb4c-51d131175580 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:30.654029 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0e20cc96-aaea-4011-bb4c-51d131175580 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:30.654490 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0e20cc96-aaea-4011-bb4c-51d131175580 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:30.656707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0e20cc96-aaea-4011-bb4c-51d131175580 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:30.657169 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0e20cc96-aaea-4011-bb4c-51d131175580 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:30.808944 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1ad2be60-4c62-4e3e-a7ee-ec13153e443f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:30.830786 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1ad2be60-4c62-4e3e-a7ee-ec13153e443f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.434608 May 16 18:51:30.836756 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 200/407] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:30 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:30.880035 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0e20cc96-aaea-4011-bb4c-51d131175580 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:30.898428 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-fce6bff7-1855-4f07-a507-844de7615357 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:30.899325 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-fce6bff7-1855-4f07-a507-844de7615357 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:30.899473 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0e20cc96-aaea-4011-bb4c-51d131175580 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.269532 May 16 18:51:30.902075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 208/408] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:30 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:30.916926 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fce6bff7-1855-4f07-a507-844de7615357 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:30.918286 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fce6bff7-1855-4f07-a507-844de7615357 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:30.920561 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fce6bff7-1855-4f07-a507-844de7615357 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:30.921956 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fce6bff7-1855-4f07-a507-844de7615357 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:31.244112 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-fa434282-2a7f-4c92-ad12-fccc89b2d116 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:31.244919 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-fa434282-2a7f-4c92-ad12-fccc89b2d116 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:31.254726 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fa434282-2a7f-4c92-ad12-fccc89b2d116 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:31.255351 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fa434282-2a7f-4c92-ad12-fccc89b2d116 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:31.257859 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fa434282-2a7f-4c92-ad12-fccc89b2d116 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:31.257859 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fa434282-2a7f-4c92-ad12-fccc89b2d116 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:31.275898 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fce6bff7-1855-4f07-a507-844de7615357 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:31.310696 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fce6bff7-1855-4f07-a507-844de7615357 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:31.313793 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fce6bff7-1855-4f07-a507-844de7615357 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:31.318819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-fce6bff7-1855-4f07-a507-844de7615357 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.422865 May 16 18:51:31.320237 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 201/409] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:30 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:51:31.429844 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0890cd86-a184-43f7-8e24-d45320415870 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:31.431753 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0890cd86-a184-43f7-8e24-d45320415870 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:31.468091 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0890cd86-a184-43f7-8e24-d45320415870 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:31.470617 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0890cd86-a184-43f7-8e24-d45320415870 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:31.471881 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0890cd86-a184-43f7-8e24-d45320415870 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:31.472525 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0890cd86-a184-43f7-8e24-d45320415870 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:31.576215 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-fa434282-2a7f-4c92-ad12-fccc89b2d116 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:31.602137 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-fa434282-2a7f-4c92-ad12-fccc89b2d116 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.362767 May 16 18:51:31.603053 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 209/410] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:31 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:31.622249 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-53e76a9c-10dd-42ae-b5e7-4d45103c28ac tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:31.622668 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-53e76a9c-10dd-42ae-b5e7-4d45103c28ac tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] [instance: 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:31.643931 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53e76a9c-10dd-42ae-b5e7-4d45103c28ac tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:31.646052 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53e76a9c-10dd-42ae-b5e7-4d45103c28ac tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:31.647268 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53e76a9c-10dd-42ae-b5e7-4d45103c28ac tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:31.648006 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53e76a9c-10dd-42ae-b5e7-4d45103c28ac tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:31.697491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-53e76a9c-10dd-42ae-b5e7-4d45103c28ac tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] HTTP exception thrown: Instance 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def could not be found. May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-53e76a9c-10dd-42ae-b5e7-4d45103c28ac tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Request method failure captured: May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def HTTP/1.1 May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpzsm6pU0SyuRdbpBbgG-hFvz-eIcfca8zLNhR_45sJ5FTHbNBlG4o_neQ43y138XNRfvEe6VNZeQrD4sRknDQpn0OT9m__pYVtwNyR43xB48tJjQgcO3Y3Am8tWHmD6B1sxwYuAbL4PP--ReKM169_v9bAiqNOXk-sg27iVsZKo0M0 May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: b7c0f4a8f9e04a71a6b71e704c29437a May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesActionsTest-1215153456 May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:51:31.699207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b7c0f4a8f9e04a71a6b71e704c29437a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b7c0f4a8f9e04a71a6b71e704c29437a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b7c0f4a8f9e04a71a6b71e704c29437a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b7c0f4a8f9e04a71a6b71e704c29437a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesActionsTest-1215153456 May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: b7c0f4a8f9e04a71a6b71e704c29437a May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesActionsTest-1215153456 May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesActionsTest-1215153456-project May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 4d2178471fe6400ea4db132f72bc334e May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesActionsTest-1215153456-project May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def could not be found. May 16 18:51:31.701519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '7bb2c41a-d2d7-4e2a-8800-91fb33ef5def'} May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def could not be found. May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:51:31.703461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def could not be found. May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def could not be found. May 16 18:51:31.705837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:51:31.707625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-53e76a9c-10dd-42ae-b5e7-4d45103c28ac tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] Returning 404 to user: Instance 7bb2c41a-d2d7-4e2a-8800-91fb33ef5def could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:51:31.707625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-53e76a9c-10dd-42ae-b5e7-4d45103c28ac tempest-VolumesActionsTest-1215153456 tempest-VolumesActionsTest-1215153456-project] 10.222.0.72 "GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def" status: 404 len: 111 microversion: 2.1 time: 0.086274 May 16 18:51:31.713878 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 210/411] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:31 2022] GET /compute/v2.1/servers/7bb2c41a-d2d7-4e2a-8800-91fb33ef5def => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:51:31.754966 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0890cd86-a184-43f7-8e24-d45320415870 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:31.780366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0890cd86-a184-43f7-8e24-d45320415870 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.363460 May 16 18:51:31.792612 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 202/412] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:31 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:31.863598 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d7a0b772-b36a-4bc4-85dd-2f69be64d9a4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:31.864263 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d7a0b772-b36a-4bc4-85dd-2f69be64d9a4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:31.882028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d7a0b772-b36a-4bc4-85dd-2f69be64d9a4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:31.882841 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d7a0b772-b36a-4bc4-85dd-2f69be64d9a4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:31.884261 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d7a0b772-b36a-4bc4-85dd-2f69be64d9a4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:31.885002 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d7a0b772-b36a-4bc4-85dd-2f69be64d9a4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:31.926241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-eeb3b757-cc48-454b-938a-77abcc1fd3ab tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:31.927374 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-eeb3b757-cc48-454b-938a-77abcc1fd3ab tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:31.944282 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eeb3b757-cc48-454b-938a-77abcc1fd3ab tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:31.945071 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eeb3b757-cc48-454b-938a-77abcc1fd3ab tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:31.946541 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eeb3b757-cc48-454b-938a-77abcc1fd3ab tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:31.949998 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eeb3b757-cc48-454b-938a-77abcc1fd3ab tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:32.231507 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-eeb3b757-cc48-454b-938a-77abcc1fd3ab tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:32.245270 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-eeb3b757-cc48-454b-938a-77abcc1fd3ab tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.329002 May 16 18:51:32.251794 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d7a0b772-b36a-4bc4-85dd-2f69be64d9a4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:32.258946 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 203/413] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:31 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:32.269734 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d7a0b772-b36a-4bc4-85dd-2f69be64d9a4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1721 microversion: 2.1 time: 0.415196 May 16 18:51:32.271206 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 211/414] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:31 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1721 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:32.363915 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b75c2041-a447-49a8-9005-87bc1316856c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:32.366041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b75c2041-a447-49a8-9005-87bc1316856c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:32.397286 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b75c2041-a447-49a8-9005-87bc1316856c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:32.399198 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b75c2041-a447-49a8-9005-87bc1316856c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:32.400876 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b75c2041-a447-49a8-9005-87bc1316856c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:32.401974 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b75c2041-a447-49a8-9005-87bc1316856c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:32.625673 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-53382acb-4d73-495e-803c-4a042fabd67d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:32.635269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-53382acb-4d73-495e-803c-4a042fabd67d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:32.655410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53382acb-4d73-495e-803c-4a042fabd67d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:32.659054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53382acb-4d73-495e-803c-4a042fabd67d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:32.661473 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53382acb-4d73-495e-803c-4a042fabd67d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:32.667263 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53382acb-4d73-495e-803c-4a042fabd67d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:32.849569 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b75c2041-a447-49a8-9005-87bc1316856c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:32.871988 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b75c2041-a447-49a8-9005-87bc1316856c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:32.874890 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b75c2041-a447-49a8-9005-87bc1316856c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:32.877597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b75c2041-a447-49a8-9005-87bc1316856c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.530725 May 16 18:51:32.888465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 204/415] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:32 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:51:32.904512 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2cef0933-1c56-4f69-8cd1-1de125e55caf tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:32.908133 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2cef0933-1c56-4f69-8cd1-1de125e55caf tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:32.928362 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2cef0933-1c56-4f69-8cd1-1de125e55caf tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:32.933520 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2cef0933-1c56-4f69-8cd1-1de125e55caf tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:32.935153 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2cef0933-1c56-4f69-8cd1-1de125e55caf tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:32.936108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2cef0933-1c56-4f69-8cd1-1de125e55caf tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:33.043788 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-53382acb-4d73-495e-803c-4a042fabd67d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:33.052975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-53382acb-4d73-495e-803c-4a042fabd67d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.434253 May 16 18:51:33.068139 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 212/416] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:32 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:33.241007 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2cef0933-1c56-4f69-8cd1-1de125e55caf tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:33.252214 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2cef0933-1c56-4f69-8cd1-1de125e55caf tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.372076 May 16 18:51:33.252927 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 205/417] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:32 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:33.270027 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-99061879-99ea-4c9a-8ef1-6921ef9bca50 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:33.271209 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-99061879-99ea-4c9a-8ef1-6921ef9bca50 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:33.285963 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-99061879-99ea-4c9a-8ef1-6921ef9bca50 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:33.287130 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-99061879-99ea-4c9a-8ef1-6921ef9bca50 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:33.288675 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-99061879-99ea-4c9a-8ef1-6921ef9bca50 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:33.294047 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-99061879-99ea-4c9a-8ef1-6921ef9bca50 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:33.303942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d4e6cb0d-35db-4261-baad-79541105647f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:33.307385 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d4e6cb0d-35db-4261-baad-79541105647f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:33.321223 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d4e6cb0d-35db-4261-baad-79541105647f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:33.322463 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d4e6cb0d-35db-4261-baad-79541105647f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:33.323980 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d4e6cb0d-35db-4261-baad-79541105647f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:33.325068 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d4e6cb0d-35db-4261-baad-79541105647f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:33.661502 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-99061879-99ea-4c9a-8ef1-6921ef9bca50 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:33.679776 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-99061879-99ea-4c9a-8ef1-6921ef9bca50 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.419244 May 16 18:51:33.680846 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 213/418] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:33 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:33.717469 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d4e6cb0d-35db-4261-baad-79541105647f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:33.733750 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d4e6cb0d-35db-4261-baad-79541105647f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1698 microversion: 2.1 time: 0.441751 May 16 18:51:33.735430 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 206/419] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:33 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1698 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:33.768672 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f7481ec5-b53a-42d7-906e-21499f94a289 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:33.780318 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f7481ec5-b53a-42d7-906e-21499f94a289 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:33.782188 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f7481ec5-b53a-42d7-906e-21499f94a289 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:33.877427 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f7481ec5-b53a-42d7-906e-21499f94a289 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Going to try to start instance {{(pid=128886) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 18:51:33.900379 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f9950a65-4941-419b-bbb5-eee9510454ad tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:33.901688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f9950a65-4941-419b-bbb5-eee9510454ad tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:33.916257 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9950a65-4941-419b-bbb5-eee9510454ad tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:33.916257 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9950a65-4941-419b-bbb5-eee9510454ad tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:33.916257 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9950a65-4941-419b-bbb5-eee9510454ad tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:33.916887 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9950a65-4941-419b-bbb5-eee9510454ad tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:33.966732 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f7481ec5-b53a-42d7-906e-21499f94a289 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/action" status: 202 len: 0 microversion: 2.1 time: 0.206071 May 16 18:51:33.981610 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 214/420] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:51:33 2022] POST /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:51:34.004416 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1162185a-e2ba-4e5b-97b6-9e020df0bb03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:34.009726 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1162185a-e2ba-4e5b-97b6-9e020df0bb03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:34.029117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1162185a-e2ba-4e5b-97b6-9e020df0bb03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:34.035790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1162185a-e2ba-4e5b-97b6-9e020df0bb03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:34.040424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1162185a-e2ba-4e5b-97b6-9e020df0bb03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:34.040962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1162185a-e2ba-4e5b-97b6-9e020df0bb03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:34.260253 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f9950a65-4941-419b-bbb5-eee9510454ad tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:34.275689 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f9950a65-4941-419b-bbb5-eee9510454ad tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:34.291150 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f9950a65-4941-419b-bbb5-eee9510454ad tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:34.293256 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f9950a65-4941-419b-bbb5-eee9510454ad tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.399024 May 16 18:51:34.294277 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 207/421] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:33 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:51:34.300101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-afc90ade-9ada-44b9-afa3-4b1f6445d0e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:34.300980 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-afc90ade-9ada-44b9-afa3-4b1f6445d0e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:34.311424 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-afc90ade-9ada-44b9-afa3-4b1f6445d0e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:34.313422 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-afc90ade-9ada-44b9-afa3-4b1f6445d0e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:34.314704 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-afc90ade-9ada-44b9-afa3-4b1f6445d0e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:34.315425 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-afc90ade-9ada-44b9-afa3-4b1f6445d0e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:34.424334 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1162185a-e2ba-4e5b-97b6-9e020df0bb03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:34.441020 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1162185a-e2ba-4e5b-97b6-9e020df0bb03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1707 microversion: 2.1 time: 0.454088 May 16 18:51:34.441611 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 215/422] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:33 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1707 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:34.506819 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-59e1296b-1e01-4dbd-a874-8429d73e0299 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:34.507448 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-59e1296b-1e01-4dbd-a874-8429d73e0299 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:34.536619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-59e1296b-1e01-4dbd-a874-8429d73e0299 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:34.537073 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-59e1296b-1e01-4dbd-a874-8429d73e0299 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:34.544629 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-59e1296b-1e01-4dbd-a874-8429d73e0299 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:34.545198 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-59e1296b-1e01-4dbd-a874-8429d73e0299 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:34.719828 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-afc90ade-9ada-44b9-afa3-4b1f6445d0e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:34.728768 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-afc90ade-9ada-44b9-afa3-4b1f6445d0e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1366 microversion: 2.1 time: 0.433043 May 16 18:51:34.731334 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 208/423] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:34 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1366 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:34.747652 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-14d2ddfc-3552-48da-a2db-76075819eafe req-d031b711-f2b9-4808-96b4-8e704e59fd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12aa2a80-3944-4ff6-9b34-ada2debe18c5", "name": "network-vif-plugged", "status": "completed", "tag": "fbd9282a-e554-4f50-b165-7ce5f6ec3daa"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:34.780138 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-14d2ddfc-3552-48da-a2db-76075819eafe req-d031b711-f2b9-4808-96b4-8e704e59fd09 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:34.782138 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-14d2ddfc-3552-48da-a2db-76075819eafe req-d031b711-f2b9-4808-96b4-8e704e59fd09 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:34.818633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-14d2ddfc-3552-48da-a2db-76075819eafe req-d031b711-f2b9-4808-96b4-8e704e59fd09 service nova] Creating event network-vif-plugged:fbd9282a-e554-4f50-b165-7ce5f6ec3daa for instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 on hv-cinder-75078 May 16 18:51:34.831343 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-14d2ddfc-3552-48da-a2db-76075819eafe req-d031b711-f2b9-4808-96b4-8e704e59fd09 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089242 May 16 18:51:34.832561 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 209/424] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:34.849386 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-61821959-8b61-4b43-8272-b89edeb082b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:34.850611 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-61821959-8b61-4b43-8272-b89edeb082b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:34.863075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-61821959-8b61-4b43-8272-b89edeb082b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:34.864423 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-61821959-8b61-4b43-8272-b89edeb082b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:34.866478 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-61821959-8b61-4b43-8272-b89edeb082b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:34.867571 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-61821959-8b61-4b43-8272-b89edeb082b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:35.519861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-59e1296b-1e01-4dbd-a874-8429d73e0299 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:35.537889 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-59e1296b-1e01-4dbd-a874-8429d73e0299 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 1.063251 May 16 18:51:35.538612 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 216/425] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:34 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:35.552027 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4e9a0a09-05fd-4966-9232-968709c9ca0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:35.552996 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-4e9a0a09-05fd-4966-9232-968709c9ca0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:35.559786 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4e9a0a09-05fd-4966-9232-968709c9ca0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:35.560478 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4e9a0a09-05fd-4966-9232-968709c9ca0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:35.561542 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4e9a0a09-05fd-4966-9232-968709c9ca0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:35.562995 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4e9a0a09-05fd-4966-9232-968709c9ca0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:35.736171 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-61821959-8b61-4b43-8272-b89edeb082b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:35.754245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-61821959-8b61-4b43-8272-b89edeb082b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.919841 May 16 18:51:35.767866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 210/426] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:34 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:35.773707 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8e71dd3d-b555-4638-aeb4-1e298091faa0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:35.774336 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8e71dd3d-b555-4638-aeb4-1e298091faa0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:35.782704 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e71dd3d-b555-4638-aeb4-1e298091faa0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:35.783538 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e71dd3d-b555-4638-aeb4-1e298091faa0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:35.784696 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e71dd3d-b555-4638-aeb4-1e298091faa0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:35.785299 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e71dd3d-b555-4638-aeb4-1e298091faa0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:35.838359 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-4e9a0a09-05fd-4966-9232-968709c9ca0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:35.854945 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-4e9a0a09-05fd-4966-9232-968709c9ca0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:35.857459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-4e9a0a09-05fd-4966-9232-968709c9ca0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:35.860709 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-4e9a0a09-05fd-4966-9232-968709c9ca0d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.320613 May 16 18:51:35.862659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 217/427] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:35 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:35.868978 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2e1d06c6-379d-4b5d-a4a7-928e45411d26 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:35.869834 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2e1d06c6-379d-4b5d-a4a7-928e45411d26 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:35.887620 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e1d06c6-379d-4b5d-a4a7-928e45411d26 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:35.889173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e1d06c6-379d-4b5d-a4a7-928e45411d26 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:35.890045 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e1d06c6-379d-4b5d-a4a7-928e45411d26 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:35.890499 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e1d06c6-379d-4b5d-a4a7-928e45411d26 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:36.173492 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8e71dd3d-b555-4638-aeb4-1e298091faa0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:36.189172 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8e71dd3d-b555-4638-aeb4-1e298091faa0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1707 microversion: 2.1 time: 0.431855 May 16 18:51:36.190042 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 211/428] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:35 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1707 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:36.311216 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2e1d06c6-379d-4b5d-a4a7-928e45411d26 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:36.325524 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2e1d06c6-379d-4b5d-a4a7-928e45411d26 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1556 microversion: 2.1 time: 0.461274 May 16 18:51:36.327614 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 218/429] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:35 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1556 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:36.353091 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-95933a07-2fe0-4f3c-abdd-e37a9faccbf8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:36.353956 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-95933a07-2fe0-4f3c-abdd-e37a9faccbf8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:36.367279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95933a07-2fe0-4f3c-abdd-e37a9faccbf8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:36.368583 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95933a07-2fe0-4f3c-abdd-e37a9faccbf8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:36.371696 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95933a07-2fe0-4f3c-abdd-e37a9faccbf8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:36.373462 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95933a07-2fe0-4f3c-abdd-e37a9faccbf8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:36.514669 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-95933a07-2fe0-4f3c-abdd-e37a9faccbf8 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169467 May 16 18:51:36.524002 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 212/430] 10.222.0.72 () {58 vars in 1274 bytes} [Mon May 16 18:51:36 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9/os-interface => generated 285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:36.571454 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-27fe3c19-87ab-46f9-8b14-bf2517ff8b48 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:36.572542 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-27fe3c19-87ab-46f9-8b14-bf2517ff8b48 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:36.597296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-27fe3c19-87ab-46f9-8b14-bf2517ff8b48 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:36.598041 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-27fe3c19-87ab-46f9-8b14-bf2517ff8b48 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:36.598705 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-27fe3c19-87ab-46f9-8b14-bf2517ff8b48 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:36.599324 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-27fe3c19-87ab-46f9-8b14-bf2517ff8b48 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:36.776245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6d101ffe-e9bf-4b5e-a1c4-c4d0e48930e6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:36.777599 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6d101ffe-e9bf-4b5e-a1c4-c4d0e48930e6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:36.788958 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d101ffe-e9bf-4b5e-a1c4-c4d0e48930e6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:36.789810 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d101ffe-e9bf-4b5e-a1c4-c4d0e48930e6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:36.790825 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d101ffe-e9bf-4b5e-a1c4-c4d0e48930e6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:36.791505 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d101ffe-e9bf-4b5e-a1c4-c4d0e48930e6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:37.477673 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-27fe3c19-87ab-46f9-8b14-bf2517ff8b48 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:37.505285 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-27fe3c19-87ab-46f9-8b14-bf2517ff8b48 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1261 microversion: 2.1 time: 0.950334 May 16 18:51:37.520276 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 219/431] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:36 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1261 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:37.532299 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b1126919-694d-4765-af1c-c0bbbeea5162 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:37.532991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b1126919-694d-4765-af1c-c0bbbeea5162 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:37.549902 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b1126919-694d-4765-af1c-c0bbbeea5162 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:37.550703 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b1126919-694d-4765-af1c-c0bbbeea5162 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:37.551852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b1126919-694d-4765-af1c-c0bbbeea5162 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:37.552381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b1126919-694d-4765-af1c-c0bbbeea5162 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:37.685808 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6d101ffe-e9bf-4b5e-a1c4-c4d0e48930e6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:37.695749 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6d101ffe-e9bf-4b5e-a1c4-c4d0e48930e6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.923306 May 16 18:51:37.697204 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 213/432] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:36 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:37.704172 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-33c89d8e-9aff-4dd9-9787-fc68ceb1a65e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:37.705240 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-33c89d8e-9aff-4dd9-9787-fc68ceb1a65e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:37.718581 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-33c89d8e-9aff-4dd9-9787-fc68ceb1a65e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:37.720092 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-33c89d8e-9aff-4dd9-9787-fc68ceb1a65e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:37.721151 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-33c89d8e-9aff-4dd9-9787-fc68ceb1a65e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:37.721891 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-33c89d8e-9aff-4dd9-9787-fc68ceb1a65e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:38.012968 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b1126919-694d-4765-af1c-c0bbbeea5162 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:38.043274 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b1126919-694d-4765-af1c-c0bbbeea5162 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:38.045514 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b1126919-694d-4765-af1c-c0bbbeea5162 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:38.047453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b1126919-694d-4765-af1c-c0bbbeea5162 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.525285 May 16 18:51:38.049392 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 220/433] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:37 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:38.146072 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-33c89d8e-9aff-4dd9-9787-fc68ceb1a65e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:38.169169 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-33c89d8e-9aff-4dd9-9787-fc68ceb1a65e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1707 microversion: 2.1 time: 0.469949 May 16 18:51:38.170600 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 214/434] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:37 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1707 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:38.539523 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2a30af3f-ddd7-418f-ad42-fdbd6a3df836 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:38.542929 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2a30af3f-ddd7-418f-ad42-fdbd6a3df836 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:38.568508 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2a30af3f-ddd7-418f-ad42-fdbd6a3df836 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:38.571052 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2a30af3f-ddd7-418f-ad42-fdbd6a3df836 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:38.575201 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2a30af3f-ddd7-418f-ad42-fdbd6a3df836 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:38.576450 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2a30af3f-ddd7-418f-ad42-fdbd6a3df836 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:38.725250 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e0b99686-1ed7-4b0b-9f9c-ebbe728b7f41 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:38.726330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e0b99686-1ed7-4b0b-9f9c-ebbe728b7f41 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:38.735348 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0b99686-1ed7-4b0b-9f9c-ebbe728b7f41 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:38.735947 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0b99686-1ed7-4b0b-9f9c-ebbe728b7f41 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:38.736835 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0b99686-1ed7-4b0b-9f9c-ebbe728b7f41 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:38.737374 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0b99686-1ed7-4b0b-9f9c-ebbe728b7f41 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:39.418501 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e0b99686-1ed7-4b0b-9f9c-ebbe728b7f41 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:39.433541 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2a30af3f-ddd7-418f-ad42-fdbd6a3df836 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:39.439081 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e0b99686-1ed7-4b0b-9f9c-ebbe728b7f41 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.718618 May 16 18:51:39.440480 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 215/435] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:38 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:39.448278 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7882b217-825b-4f39-ab90-13c8c0db3fa3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:39.449562 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7882b217-825b-4f39-ab90-13c8c0db3fa3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:39.455325 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2a30af3f-ddd7-418f-ad42-fdbd6a3df836 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1445 microversion: 2.1 time: 0.924832 May 16 18:51:39.466801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 221/436] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:38 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1445 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:39.467121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7882b217-825b-4f39-ab90-13c8c0db3fa3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:39.467121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7882b217-825b-4f39-ab90-13c8c0db3fa3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:39.467121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7882b217-825b-4f39-ab90-13c8c0db3fa3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:39.467121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7882b217-825b-4f39-ab90-13c8c0db3fa3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:39.467665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7257cda9-60c1-4f85-a6c5-08b6df24f6d7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:39.467665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7257cda9-60c1-4f85-a6c5-08b6df24f6d7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:39.484593 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7257cda9-60c1-4f85-a6c5-08b6df24f6d7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:39.485256 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7257cda9-60c1-4f85-a6c5-08b6df24f6d7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:39.486202 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7257cda9-60c1-4f85-a6c5-08b6df24f6d7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:39.492054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7257cda9-60c1-4f85-a6c5-08b6df24f6d7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:39.899395 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7882b217-825b-4f39-ab90-13c8c0db3fa3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:39.920181 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7882b217-825b-4f39-ab90-13c8c0db3fa3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:39.925446 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7882b217-825b-4f39-ab90-13c8c0db3fa3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:39.927596 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7882b217-825b-4f39-ab90-13c8c0db3fa3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.485285 May 16 18:51:39.944376 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 216/437] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:39 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:39.959985 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1714205f-ae28-4b05-a66c-97e7d07c2c1d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:39.961116 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1714205f-ae28-4b05-a66c-97e7d07c2c1d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:39.975621 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1714205f-ae28-4b05-a66c-97e7d07c2c1d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:39.976020 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7257cda9-60c1-4f85-a6c5-08b6df24f6d7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:39.977031 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1714205f-ae28-4b05-a66c-97e7d07c2c1d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:39.978333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1714205f-ae28-4b05-a66c-97e7d07c2c1d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:39.979055 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1714205f-ae28-4b05-a66c-97e7d07c2c1d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:40.008932 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7257cda9-60c1-4f85-a6c5-08b6df24f6d7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1707 microversion: 2.1 time: 0.551456 May 16 18:51:40.016314 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 222/438] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:39 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1707 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:40.090535 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-ff04c30d-20fc-43a8-afeb-64a4b937921e req-691fccc3-9175-4ad1-9db9-2147cd7b1276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6715a3-0274-463c-b6e5-4116112ef2c9", "tag": "e2de6415-3434-48d3-a9f3-46de3d297b6e"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:40.107972 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-ff04c30d-20fc-43a8-afeb-64a4b937921e req-691fccc3-9175-4ad1-9db9-2147cd7b1276 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:40.109374 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-ff04c30d-20fc-43a8-afeb-64a4b937921e req-691fccc3-9175-4ad1-9db9-2147cd7b1276 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:40.141587 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-ff04c30d-20fc-43a8-afeb-64a4b937921e req-691fccc3-9175-4ad1-9db9-2147cd7b1276 service nova] Creating event network-changed:e2de6415-3434-48d3-a9f3-46de3d297b6e for instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 on hv-cinder-75078 May 16 18:51:40.168229 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-ff04c30d-20fc-43a8-afeb-64a4b937921e req-691fccc3-9175-4ad1-9db9-2147cd7b1276 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082249 May 16 18:51:40.176340 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 223/439] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:51:40.434326 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1714205f-ae28-4b05-a66c-97e7d07c2c1d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:40.456348 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1714205f-ae28-4b05-a66c-97e7d07c2c1d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1445 microversion: 2.1 time: 0.510312 May 16 18:51:40.456950 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 217/440] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:39 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1445 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:40.517296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-67fadc4f-e351-4c3a-bed0-f6c8fd4999c7 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:40.521915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-67fadc4f-e351-4c3a-bed0-f6c8fd4999c7 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:40.552419 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-67fadc4f-e351-4c3a-bed0-f6c8fd4999c7 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:40.553709 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-67fadc4f-e351-4c3a-bed0-f6c8fd4999c7 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:40.555849 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-67fadc4f-e351-4c3a-bed0-f6c8fd4999c7 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:40.557265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-67fadc4f-e351-4c3a-bed0-f6c8fd4999c7 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:40.850094 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-67fadc4f-e351-4c3a-bed0-f6c8fd4999c7 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:40.861568 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-67fadc4f-e351-4c3a-bed0-f6c8fd4999c7 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.393223 May 16 18:51:40.866206 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 224/441] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:40 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:40.972145 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-85c52bd4-c96d-43d9-a29d-81de0b5ff49f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:40.975154 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-85c52bd4-c96d-43d9-a29d-81de0b5ff49f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:40.998174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-85c52bd4-c96d-43d9-a29d-81de0b5ff49f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:40.999261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-85c52bd4-c96d-43d9-a29d-81de0b5ff49f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:41.001525 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-85c52bd4-c96d-43d9-a29d-81de0b5ff49f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:41.002616 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-85c52bd4-c96d-43d9-a29d-81de0b5ff49f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:41.031618 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8c7547bf-2c39-4fac-aa88-0c5131409b2c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:41.031618 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8c7547bf-2c39-4fac-aa88-0c5131409b2c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:41.042105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c7547bf-2c39-4fac-aa88-0c5131409b2c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:41.042565 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c7547bf-2c39-4fac-aa88-0c5131409b2c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:41.043353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c7547bf-2c39-4fac-aa88-0c5131409b2c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:41.046241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c7547bf-2c39-4fac-aa88-0c5131409b2c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:41.579586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8c7547bf-2c39-4fac-aa88-0c5131409b2c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:41.595124 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8c7547bf-2c39-4fac-aa88-0c5131409b2c tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1707 microversion: 2.1 time: 0.569433 May 16 18:51:41.596912 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 225/442] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:41 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1707 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:41.690891 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-85c52bd4-c96d-43d9-a29d-81de0b5ff49f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:41.728979 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-85c52bd4-c96d-43d9-a29d-81de0b5ff49f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:41.733527 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-85c52bd4-c96d-43d9-a29d-81de0b5ff49f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:41.737009 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-85c52bd4-c96d-43d9-a29d-81de0b5ff49f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.780007 May 16 18:51:41.738861 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 218/443] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:40 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:41.894288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-156bd288-b15c-4d65-8baf-6d693adcf0b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:41.895674 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-156bd288-b15c-4d65-8baf-6d693adcf0b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:41.915379 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-156bd288-b15c-4d65-8baf-6d693adcf0b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:41.927756 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-156bd288-b15c-4d65-8baf-6d693adcf0b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:41.929247 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-156bd288-b15c-4d65-8baf-6d693adcf0b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:41.930029 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-156bd288-b15c-4d65-8baf-6d693adcf0b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:42.350466 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-156bd288-b15c-4d65-8baf-6d693adcf0b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:42.386088 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-156bd288-b15c-4d65-8baf-6d693adcf0b8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.494788 May 16 18:51:42.402808 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 226/444] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:41 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:42.627317 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c55d5591-2f3a-489a-b6ed-33c85d150813 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:42.628265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c55d5591-2f3a-489a-b6ed-33c85d150813 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:42.654461 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c55d5591-2f3a-489a-b6ed-33c85d150813 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:42.655125 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c55d5591-2f3a-489a-b6ed-33c85d150813 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:42.657088 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c55d5591-2f3a-489a-b6ed-33c85d150813 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:42.657817 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c55d5591-2f3a-489a-b6ed-33c85d150813 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:42.768050 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-25c4fa8f-aa24-45c0-9ca4-670b32ab57bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:42.769307 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-25c4fa8f-aa24-45c0-9ca4-670b32ab57bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:42.778529 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-25c4fa8f-aa24-45c0-9ca4-670b32ab57bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:42.785567 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-25c4fa8f-aa24-45c0-9ca4-670b32ab57bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:42.787002 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-25c4fa8f-aa24-45c0-9ca4-670b32ab57bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:42.787449 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-25c4fa8f-aa24-45c0-9ca4-670b32ab57bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:42.982748 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c55d5591-2f3a-489a-b6ed-33c85d150813 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:43.008317 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c55d5591-2f3a-489a-b6ed-33c85d150813 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1711 microversion: 2.1 time: 0.391371 May 16 18:51:43.032805 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 219/445] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:42 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1711 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:43.125763 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-25c4fa8f-aa24-45c0-9ca4-670b32ab57bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:43.158339 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-25c4fa8f-aa24-45c0-9ca4-670b32ab57bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:43.161715 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-25c4fa8f-aa24-45c0-9ca4-670b32ab57bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:43.164523 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-25c4fa8f-aa24-45c0-9ca4-670b32ab57bc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.400707 May 16 18:51:43.166250 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 227/446] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:42 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:43.432005 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5e29d1c3-41bd-49cf-af7e-92f496eb1cd9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:43.432895 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5e29d1c3-41bd-49cf-af7e-92f496eb1cd9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:43.460054 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5e29d1c3-41bd-49cf-af7e-92f496eb1cd9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:43.461017 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5e29d1c3-41bd-49cf-af7e-92f496eb1cd9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:43.462500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5e29d1c3-41bd-49cf-af7e-92f496eb1cd9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:43.463547 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5e29d1c3-41bd-49cf-af7e-92f496eb1cd9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:43.756858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5e29d1c3-41bd-49cf-af7e-92f496eb1cd9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:43.773294 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5e29d1c3-41bd-49cf-af7e-92f496eb1cd9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.364677 May 16 18:51:43.774488 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 220/447] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:43 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:44.189886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-03d4a839-20e8-4389-98a7-e44dfcb5b92e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:44.191999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-03d4a839-20e8-4389-98a7-e44dfcb5b92e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:44.208227 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03d4a839-20e8-4389-98a7-e44dfcb5b92e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:44.210058 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03d4a839-20e8-4389-98a7-e44dfcb5b92e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:44.211788 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03d4a839-20e8-4389-98a7-e44dfcb5b92e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:44.212817 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-03d4a839-20e8-4389-98a7-e44dfcb5b92e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:44.434912 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-03d4a839-20e8-4389-98a7-e44dfcb5b92e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:44.445176 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-03d4a839-20e8-4389-98a7-e44dfcb5b92e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:44.446754 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-03d4a839-20e8-4389-98a7-e44dfcb5b92e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:44.447974 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-03d4a839-20e8-4389-98a7-e44dfcb5b92e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.265792 May 16 18:51:44.449204 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 228/448] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:44 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:44.491394 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-48f12faf-3005-41ac-a16d-39e964fc3226 req-26ffd901-8102-4d95-b9dc-a170ad08eeca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12aa2a80-3944-4ff6-9b34-ada2debe18c5", "tag": "fbd9282a-e554-4f50-b165-7ce5f6ec3daa"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:44.505307 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-48f12faf-3005-41ac-a16d-39e964fc3226 req-26ffd901-8102-4d95-b9dc-a170ad08eeca service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:44.505839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-48f12faf-3005-41ac-a16d-39e964fc3226 req-26ffd901-8102-4d95-b9dc-a170ad08eeca service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:44.521542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-48f12faf-3005-41ac-a16d-39e964fc3226 req-26ffd901-8102-4d95-b9dc-a170ad08eeca service nova] Creating event network-changed:fbd9282a-e554-4f50-b165-7ce5f6ec3daa for instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 on hv-cinder-75078 May 16 18:51:44.526527 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-48f12faf-3005-41ac-a16d-39e964fc3226 req-26ffd901-8102-4d95-b9dc-a170ad08eeca service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039604 May 16 18:51:44.527447 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 221/449] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:44.808288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e62071e4-adc8-412c-a3bc-9b6c1e0b004c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:44.809556 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-e62071e4-adc8-412c-a3bc-9b6c1e0b004c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:44.828662 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e62071e4-adc8-412c-a3bc-9b6c1e0b004c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:44.829818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e62071e4-adc8-412c-a3bc-9b6c1e0b004c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:44.832434 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e62071e4-adc8-412c-a3bc-9b6c1e0b004c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:44.833461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e62071e4-adc8-412c-a3bc-9b6c1e0b004c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:45.051699 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e62071e4-adc8-412c-a3bc-9b6c1e0b004c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:45.067832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e62071e4-adc8-412c-a3bc-9b6c1e0b004c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.272176 May 16 18:51:45.068772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 229/450] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:44 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:45.469494 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7236f590-2d7e-4276-b96f-c8725028885c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:45.470472 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7236f590-2d7e-4276-b96f-c8725028885c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:45.477977 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7236f590-2d7e-4276-b96f-c8725028885c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:45.478633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7236f590-2d7e-4276-b96f-c8725028885c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:45.479595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7236f590-2d7e-4276-b96f-c8725028885c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:45.480292 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7236f590-2d7e-4276-b96f-c8725028885c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:45.657716 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7236f590-2d7e-4276-b96f-c8725028885c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:45.670085 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7236f590-2d7e-4276-b96f-c8725028885c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:45.672575 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7236f590-2d7e-4276-b96f-c8725028885c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:45.674393 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7236f590-2d7e-4276-b96f-c8725028885c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.210732 May 16 18:51:45.675117 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 222/451] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:45 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:46.086119 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0a32646b-678d-4308-b684-2f9ab5b6b78d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:46.087066 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0a32646b-678d-4308-b684-2f9ab5b6b78d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:46.097613 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a32646b-678d-4308-b684-2f9ab5b6b78d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:46.098294 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a32646b-678d-4308-b684-2f9ab5b6b78d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:46.099309 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a32646b-678d-4308-b684-2f9ab5b6b78d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:46.099690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a32646b-678d-4308-b684-2f9ab5b6b78d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:46.273453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0a32646b-678d-4308-b684-2f9ab5b6b78d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:46.286093 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0a32646b-678d-4308-b684-2f9ab5b6b78d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.203936 May 16 18:51:46.287115 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 230/452] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:46 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:46.695080 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5530c617-9ae6-4832-8fee-9f7cd3d9f629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:46.696312 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5530c617-9ae6-4832-8fee-9f7cd3d9f629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:46.704934 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5530c617-9ae6-4832-8fee-9f7cd3d9f629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:46.705838 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5530c617-9ae6-4832-8fee-9f7cd3d9f629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:46.707303 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5530c617-9ae6-4832-8fee-9f7cd3d9f629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:46.708129 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5530c617-9ae6-4832-8fee-9f7cd3d9f629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:46.901467 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5530c617-9ae6-4832-8fee-9f7cd3d9f629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:46.915160 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5530c617-9ae6-4832-8fee-9f7cd3d9f629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:46.917730 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5530c617-9ae6-4832-8fee-9f7cd3d9f629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:46.918625 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5530c617-9ae6-4832-8fee-9f7cd3d9f629 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1739 microversion: 2.20 time: 0.227859 May 16 18:51:46.919647 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 223/453] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:46 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:47.309585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3cc486cd-6831-48ff-8f6a-aece76816d79 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:47.312040 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3cc486cd-6831-48ff-8f6a-aece76816d79 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:47.324135 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3cc486cd-6831-48ff-8f6a-aece76816d79 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:47.324974 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3cc486cd-6831-48ff-8f6a-aece76816d79 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:47.326393 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3cc486cd-6831-48ff-8f6a-aece76816d79 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:47.327997 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3cc486cd-6831-48ff-8f6a-aece76816d79 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:47.687676 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3cc486cd-6831-48ff-8f6a-aece76816d79 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:47.695983 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3cc486cd-6831-48ff-8f6a-aece76816d79 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.393642 May 16 18:51:47.696570 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 231/454] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:47 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:47.951398 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3ebd394c-5f40-4eea-b6b2-4a629497ece0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:47.953824 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-3ebd394c-5f40-4eea-b6b2-4a629497ece0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:47.972534 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3ebd394c-5f40-4eea-b6b2-4a629497ece0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:47.973969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3ebd394c-5f40-4eea-b6b2-4a629497ece0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:47.975406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3ebd394c-5f40-4eea-b6b2-4a629497ece0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:47.976482 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3ebd394c-5f40-4eea-b6b2-4a629497ece0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:48.177403 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-3ebd394c-5f40-4eea-b6b2-4a629497ece0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:48.190770 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-3ebd394c-5f40-4eea-b6b2-4a629497ece0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:48.194225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-3ebd394c-5f40-4eea-b6b2-4a629497ece0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:48.198388 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3ebd394c-5f40-4eea-b6b2-4a629497ece0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1721 microversion: 2.20 time: 0.255924 May 16 18:51:48.199347 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 224/455] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:47 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:48.723738 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0255446f-1e26-43e1-9117-b347210e6599 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:48.725583 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0255446f-1e26-43e1-9117-b347210e6599 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:48.744668 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0255446f-1e26-43e1-9117-b347210e6599 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:48.746486 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0255446f-1e26-43e1-9117-b347210e6599 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:48.747591 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0255446f-1e26-43e1-9117-b347210e6599 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:48.748247 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0255446f-1e26-43e1-9117-b347210e6599 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:48.961503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0255446f-1e26-43e1-9117-b347210e6599 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:48.977120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0255446f-1e26-43e1-9117-b347210e6599 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.261971 May 16 18:51:48.992716 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 232/456] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:48 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:49.225110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-345e71d4-5aff-4266-909e-8238eee0b9be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:49.226607 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-345e71d4-5aff-4266-909e-8238eee0b9be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:49.238743 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-345e71d4-5aff-4266-909e-8238eee0b9be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:49.241120 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-345e71d4-5aff-4266-909e-8238eee0b9be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:49.244556 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-345e71d4-5aff-4266-909e-8238eee0b9be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:49.245403 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-345e71d4-5aff-4266-909e-8238eee0b9be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:49.493936 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-345e71d4-5aff-4266-909e-8238eee0b9be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:49.506215 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-345e71d4-5aff-4266-909e-8238eee0b9be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:49.508619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-345e71d4-5aff-4266-909e-8238eee0b9be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:49.510938 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-345e71d4-5aff-4266-909e-8238eee0b9be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1721 microversion: 2.20 time: 0.294601 May 16 18:51:49.511698 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 225/457] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:49 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:50.013888 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f23cd98b-c9db-4d35-a376-fe74634a8775 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:50.016617 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f23cd98b-c9db-4d35-a376-fe74634a8775 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:50.029783 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f23cd98b-c9db-4d35-a376-fe74634a8775 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:50.031630 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f23cd98b-c9db-4d35-a376-fe74634a8775 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:50.033244 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f23cd98b-c9db-4d35-a376-fe74634a8775 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:50.034349 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f23cd98b-c9db-4d35-a376-fe74634a8775 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:50.271872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f23cd98b-c9db-4d35-a376-fe74634a8775 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:50.283616 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f23cd98b-c9db-4d35-a376-fe74634a8775 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.277303 May 16 18:51:50.295685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 233/458] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:50 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:50.493417 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-bbd6d996-23c5-4064-b4a5-36d5cded5794 req-9329a872-90d7-42c0-a866-db3d4efdbde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de1432f-5419-4150-84a0-0fe456962ce9", "name": "network-vif-unplugged", "status": "completed", "tag": "eeb3fe2b-d9aa-4852-85f0-2e9f90328234"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:50.516454 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-bbd6d996-23c5-4064-b4a5-36d5cded5794 req-9329a872-90d7-42c0-a866-db3d4efdbde1 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:50.517546 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-bbd6d996-23c5-4064-b4a5-36d5cded5794 req-9329a872-90d7-42c0-a866-db3d4efdbde1 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:50.540889 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9cf4cfa7-3571-4bef-a92e-71fd6b7b40d6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:50.542502 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9cf4cfa7-3571-4bef-a92e-71fd6b7b40d6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:50.554539 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9cf4cfa7-3571-4bef-a92e-71fd6b7b40d6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:50.556206 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9cf4cfa7-3571-4bef-a92e-71fd6b7b40d6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:50.558817 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9cf4cfa7-3571-4bef-a92e-71fd6b7b40d6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:50.563351 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9cf4cfa7-3571-4bef-a92e-71fd6b7b40d6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:50.565089 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-bbd6d996-23c5-4064-b4a5-36d5cded5794 req-9329a872-90d7-42c0-a866-db3d4efdbde1 service nova] Creating event network-vif-unplugged:eeb3fe2b-d9aa-4852-85f0-2e9f90328234 for instance 4de1432f-5419-4150-84a0-0fe456962ce9 on hv-cinder-75078 May 16 18:51:50.580860 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-bbd6d996-23c5-4064-b4a5-36d5cded5794 req-9329a872-90d7-42c0-a866-db3d4efdbde1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092108 May 16 18:51:50.582340 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 226/459] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:51:50.756365 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9cf4cfa7-3571-4bef-a92e-71fd6b7b40d6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:50.764181 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9cf4cfa7-3571-4bef-a92e-71fd6b7b40d6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:50.766317 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9cf4cfa7-3571-4bef-a92e-71fd6b7b40d6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:50.767479 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9cf4cfa7-3571-4bef-a92e-71fd6b7b40d6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1721 microversion: 2.20 time: 0.231154 May 16 18:51:50.768064 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 234/460] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:50 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:51.308279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a243a959-f772-430b-bd5f-da2da373672e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:51.309504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a243a959-f772-430b-bd5f-da2da373672e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:51.324556 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a243a959-f772-430b-bd5f-da2da373672e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:51.334656 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a243a959-f772-430b-bd5f-da2da373672e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:51.335878 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a243a959-f772-430b-bd5f-da2da373672e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:51.336499 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a243a959-f772-430b-bd5f-da2da373672e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:51.548313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a243a959-f772-430b-bd5f-da2da373672e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:51.558046 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a243a959-f772-430b-bd5f-da2da373672e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.257864 May 16 18:51:51.558778 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 227/461] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:51 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:51.789700 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-04342d4e-a539-457f-8309-1a04a6a00123 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:51.792021 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-04342d4e-a539-457f-8309-1a04a6a00123 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:51.803674 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-04342d4e-a539-457f-8309-1a04a6a00123 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:51.804577 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-04342d4e-a539-457f-8309-1a04a6a00123 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:51.805637 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-04342d4e-a539-457f-8309-1a04a6a00123 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:51.806464 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-04342d4e-a539-457f-8309-1a04a6a00123 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:52.146021 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-04342d4e-a539-457f-8309-1a04a6a00123 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:52.160293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-04342d4e-a539-457f-8309-1a04a6a00123 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:52.171387 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-04342d4e-a539-457f-8309-1a04a6a00123 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:52.171387 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-04342d4e-a539-457f-8309-1a04a6a00123 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1724 microversion: 2.20 time: 0.382331 May 16 18:51:52.181440 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 235/462] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:51 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:52.230530 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1b301ce7-83b0-4dfe-9892-fe0b2b65d21e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13bfe0cd-115b-4d43-97ca-f8bb0f89bfe7"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:52.232838 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1b301ce7-83b0-4dfe-9892-fe0b2b65d21e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:52.242029 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1b301ce7-83b0-4dfe-9892-fe0b2b65d21e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:52.242972 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1b301ce7-83b0-4dfe-9892-fe0b2b65d21e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:52.244138 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1b301ce7-83b0-4dfe-9892-fe0b2b65d21e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:52.256444 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1b301ce7-83b0-4dfe-9892-fe0b2b65d21e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:52.587058 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a502da7e-21c5-4f7c-8b24-256f0a678174 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:52.588600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a502da7e-21c5-4f7c-8b24-256f0a678174 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:52.598359 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a502da7e-21c5-4f7c-8b24-256f0a678174 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:52.599607 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a502da7e-21c5-4f7c-8b24-256f0a678174 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:52.601211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a502da7e-21c5-4f7c-8b24-256f0a678174 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:52.602160 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a502da7e-21c5-4f7c-8b24-256f0a678174 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:52.881937 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a502da7e-21c5-4f7c-8b24-256f0a678174 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:52.887621 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1b301ce7-83b0-4dfe-9892-fe0b2b65d21e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "POST /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.690929 May 16 18:51:52.890612 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 228/463] 10.222.0.72 () {62 vars in 1363 bytes} [Mon May 16 18:51:52 2022] POST /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-volume_attachments => generated 188 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:51:52.903735 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a502da7e-21c5-4f7c-8b24-256f0a678174 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.324482 May 16 18:51:52.904792 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 236/464] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:52 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:53.115018 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-43328759-a0ac-4489-b9ff-0ab92e179cf4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:53.115924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-43328759-a0ac-4489-b9ff-0ab92e179cf4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:53.126287 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43328759-a0ac-4489-b9ff-0ab92e179cf4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:53.126792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43328759-a0ac-4489-b9ff-0ab92e179cf4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:53.127550 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43328759-a0ac-4489-b9ff-0ab92e179cf4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:53.128333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43328759-a0ac-4489-b9ff-0ab92e179cf4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:53.259289 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-43328759-a0ac-4489-b9ff-0ab92e179cf4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "POST /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/action" status: 202 len: 0 microversion: 2.20 time: 0.150762 May 16 18:51:53.260420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 229/465] 10.222.0.72 () {62 vars in 1318 bytes} [Mon May 16 18:51:53 2022] POST /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 16 18:51:53.274252 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-aa093cb5-9e25-4654-a1a4-e11ca8707c41 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:53.275475 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-aa093cb5-9e25-4654-a1a4-e11ca8707c41 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:53.287028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa093cb5-9e25-4654-a1a4-e11ca8707c41 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:53.288337 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa093cb5-9e25-4654-a1a4-e11ca8707c41 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:53.290200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa093cb5-9e25-4654-a1a4-e11ca8707c41 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:53.291266 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa093cb5-9e25-4654-a1a4-e11ca8707c41 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:53.521846 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-aa093cb5-9e25-4654-a1a4-e11ca8707c41 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:53.535115 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-aa093cb5-9e25-4654-a1a4-e11ca8707c41 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:53.537745 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-aa093cb5-9e25-4654-a1a4-e11ca8707c41 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:53.539402 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-aa093cb5-9e25-4654-a1a4-e11ca8707c41 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1750 microversion: 2.20 time: 0.272600 May 16 18:51:53.540338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 237/466] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:53 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1750 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:53.835026 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1453947714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-426666422", "security_groups": [{"name": "tempest-secgroup-smoke-1652304659"}], "block_device_mapping_v2": [{"uuid": "59bc089c-ebd6-4185-8a6e-c3db1969da74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bdc43d0-da09-483c-a5e7-ef200c0654fb"}]}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:51:53.941149 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-dee94864-df7d-428f-8f3d-7c0393fc9409 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:53.944340 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-dee94864-df7d-428f-8f3d-7c0393fc9409 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:53.959178 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dee94864-df7d-428f-8f3d-7c0393fc9409 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:53.959991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dee94864-df7d-428f-8f3d-7c0393fc9409 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:53.961611 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dee94864-df7d-428f-8f3d-7c0393fc9409 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:53.962480 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dee94864-df7d-428f-8f3d-7c0393fc9409 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:54.183555 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] validate_networks() for [('3bdc43d0-da09-483c-a5e7-ef200c0654fb', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:51:54.508281 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dee94864-df7d-428f-8f3d-7c0393fc9409 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:54.526633 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-dee94864-df7d-428f-8f3d-7c0393fc9409 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.602508 May 16 18:51:54.539017 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 238/467] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:53 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:54.564811 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f53e4030-5d9d-45a3-8163-ca71edc04c2a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:54.565831 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f53e4030-5d9d-45a3-8163-ca71edc04c2a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:54.575459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f53e4030-5d9d-45a3-8163-ca71edc04c2a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:54.577060 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f53e4030-5d9d-45a3-8163-ca71edc04c2a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:54.578122 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f53e4030-5d9d-45a3-8163-ca71edc04c2a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:54.578780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f53e4030-5d9d-45a3-8163-ca71edc04c2a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:55.027140 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f53e4030-5d9d-45a3-8163-ca71edc04c2a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:55.058269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f53e4030-5d9d-45a3-8163-ca71edc04c2a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:55.067681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f53e4030-5d9d-45a3-8163-ca71edc04c2a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:55.070373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f53e4030-5d9d-45a3-8163-ca71edc04c2a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1750 microversion: 2.20 time: 0.510502 May 16 18:51:55.077211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 239/468] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:54 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1750 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:55.257654 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:51:55.259925 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:51:55.260276 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:51:55.261040 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:51:55.261992 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:51:55.290537 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:55.291401 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:55.293073 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:55.293839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:55.340452 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Getting quotas for project 5b168bfd42a645269b47c98f4210e4aa. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:51:55.349534 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Getting quotas for user 5e9ebfaac4984817bb768476ef74445c and project 5b168bfd42a645269b47c98f4210e4aa. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:51:55.476020 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:51:55.480935 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59bc089c-ebd6-4185-8a6e-c3db1969da74',volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:51:55.551635 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e55d77c8-52f3-4932-96b6-b8a39f71ea4b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:55.552686 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-e55d77c8-52f3-4932-96b6-b8a39f71ea4b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:55.567811 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e55d77c8-52f3-4932-96b6-b8a39f71ea4b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:55.568590 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e55d77c8-52f3-4932-96b6-b8a39f71ea4b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:55.569581 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e55d77c8-52f3-4932-96b6-b8a39f71ea4b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:55.570295 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e55d77c8-52f3-4932-96b6-b8a39f71ea4b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:55.777049 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-43eff857-0eb1-48c1-936d-0b23978fd462 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.949578 May 16 18:51:55.787065 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 230/469] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:51:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:51:55.798561 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-06f1fa62-ed49-42a4-9380-d1518d9260eb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:55.799265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-06f1fa62-ed49-42a4-9380-d1518d9260eb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:55.896282 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e55d77c8-52f3-4932-96b6-b8a39f71ea4b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:55.927327 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-06f1fa62-ed49-42a4-9380-d1518d9260eb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:55.931790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e55d77c8-52f3-4932-96b6-b8a39f71ea4b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.388395 May 16 18:51:55.938344 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 240/470] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:55 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:55.945747 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-06f1fa62-ed49-42a4-9380-d1518d9260eb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1094 microversion: 2.1 time: 0.157499 May 16 18:51:55.956122 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 231/471] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:55 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1094 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:56.114234 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-17dc0132-466a-46f3-90a4-9cf24d9d1628 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:56.115386 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-17dc0132-466a-46f3-90a4-9cf24d9d1628 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:56.127373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-17dc0132-466a-46f3-90a4-9cf24d9d1628 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:56.128204 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-17dc0132-466a-46f3-90a4-9cf24d9d1628 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:56.129688 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-17dc0132-466a-46f3-90a4-9cf24d9d1628 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:56.130637 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-17dc0132-466a-46f3-90a4-9cf24d9d1628 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:56.476443 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-17dc0132-466a-46f3-90a4-9cf24d9d1628 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:56.491561 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-17dc0132-466a-46f3-90a4-9cf24d9d1628 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:56.495201 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-17dc0132-466a-46f3-90a4-9cf24d9d1628 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:56.497777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-17dc0132-466a-46f3-90a4-9cf24d9d1628 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1752 microversion: 2.20 time: 0.392185 May 16 18:51:56.512417 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 241/472] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:56 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1752 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:56.962919 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d024f56c-09ca-4daf-a839-ba48d65cf79b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:56.963990 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d024f56c-09ca-4daf-a839-ba48d65cf79b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:56.970267 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d2493af6-c7ec-4940-843e-c4966965dcb5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:56.971822 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d2493af6-c7ec-4940-843e-c4966965dcb5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:56.979728 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d024f56c-09ca-4daf-a839-ba48d65cf79b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:56.980224 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d024f56c-09ca-4daf-a839-ba48d65cf79b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:56.980534 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2493af6-c7ec-4940-843e-c4966965dcb5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:56.981123 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2493af6-c7ec-4940-843e-c4966965dcb5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:56.981287 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d024f56c-09ca-4daf-a839-ba48d65cf79b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:56.982271 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d024f56c-09ca-4daf-a839-ba48d65cf79b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:56.984556 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2493af6-c7ec-4940-843e-c4966965dcb5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:56.985923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2493af6-c7ec-4940-843e-c4966965dcb5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:57.145805 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d2493af6-c7ec-4940-843e-c4966965dcb5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:57.156221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d2493af6-c7ec-4940-843e-c4966965dcb5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1192 microversion: 2.1 time: 0.193242 May 16 18:51:57.158081 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 242/473] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:56 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1192 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:57.273668 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d024f56c-09ca-4daf-a839-ba48d65cf79b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:57.288226 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d024f56c-09ca-4daf-a839-ba48d65cf79b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.329811 May 16 18:51:57.297878 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 232/474] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:56 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:57.534277 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-18561d8c-fd54-4afd-ab85-e84bc95a7b87 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:57.539392 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-18561d8c-fd54-4afd-ab85-e84bc95a7b87 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:57.559963 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-18561d8c-fd54-4afd-ab85-e84bc95a7b87 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:57.561162 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-18561d8c-fd54-4afd-ab85-e84bc95a7b87 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:57.562355 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-18561d8c-fd54-4afd-ab85-e84bc95a7b87 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:57.563031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-18561d8c-fd54-4afd-ab85-e84bc95a7b87 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:57.961406 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-18561d8c-fd54-4afd-ab85-e84bc95a7b87 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:57.988745 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-18561d8c-fd54-4afd-ab85-e84bc95a7b87 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:57.993876 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-18561d8c-fd54-4afd-ab85-e84bc95a7b87 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:58.000476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-18561d8c-fd54-4afd-ab85-e84bc95a7b87 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1752 microversion: 2.20 time: 0.474595 May 16 18:51:58.015746 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 243/475] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:57 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1752 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:58.177221 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-070f498e-cf02-4a19-9a1a-a68d063a56e5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:58.177956 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-070f498e-cf02-4a19-9a1a-a68d063a56e5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:58.188137 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-070f498e-cf02-4a19-9a1a-a68d063a56e5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:58.189300 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-070f498e-cf02-4a19-9a1a-a68d063a56e5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:58.190614 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-070f498e-cf02-4a19-9a1a-a68d063a56e5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:58.191485 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-070f498e-cf02-4a19-9a1a-a68d063a56e5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:58.302090 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-070f498e-cf02-4a19-9a1a-a68d063a56e5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:58.316977 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-070f498e-cf02-4a19-9a1a-a68d063a56e5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1210 microversion: 2.1 time: 0.145252 May 16 18:51:58.317960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0bbc1390-2cf1-431f-bb01-5d4f8b23e098 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:58.330437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 233/476] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:58 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1210 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:51:58.332111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0bbc1390-2cf1-431f-bb01-5d4f8b23e098 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:58.339638 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0bbc1390-2cf1-431f-bb01-5d4f8b23e098 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:58.340157 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0bbc1390-2cf1-431f-bb01-5d4f8b23e098 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:58.340913 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0bbc1390-2cf1-431f-bb01-5d4f8b23e098 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:58.341351 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0bbc1390-2cf1-431f-bb01-5d4f8b23e098 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:58.834513 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0bbc1390-2cf1-431f-bb01-5d4f8b23e098 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:58.844702 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0bbc1390-2cf1-431f-bb01-5d4f8b23e098 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.535680 May 16 18:51:58.845846 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 244/477] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:58 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:59.032474 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-147eb78e-ce11-47ea-ae44-f7419739feeb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:59.033783 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-147eb78e-ce11-47ea-ae44-f7419739feeb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:59.043522 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-147eb78e-ce11-47ea-ae44-f7419739feeb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:59.044045 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-147eb78e-ce11-47ea-ae44-f7419739feeb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:59.045186 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-147eb78e-ce11-47ea-ae44-f7419739feeb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:59.046509 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-147eb78e-ce11-47ea-ae44-f7419739feeb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:59.256048 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-147eb78e-ce11-47ea-ae44-f7419739feeb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:59.274566 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-147eb78e-ce11-47ea-ae44-f7419739feeb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:59.277915 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-147eb78e-ce11-47ea-ae44-f7419739feeb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:59.279889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-147eb78e-ce11-47ea-ae44-f7419739feeb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.255343 May 16 18:51:59.281633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 234/478] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:51:59 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:51:59.344177 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c0368d07-2e40-497f-a41f-5e602436d89d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:59.345081 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c0368d07-2e40-497f-a41f-5e602436d89d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:59.358308 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c0368d07-2e40-497f-a41f-5e602436d89d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:59.359294 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c0368d07-2e40-497f-a41f-5e602436d89d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:59.360782 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c0368d07-2e40-497f-a41f-5e602436d89d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:59.362134 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c0368d07-2e40-497f-a41f-5e602436d89d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:59.486521 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c0368d07-2e40-497f-a41f-5e602436d89d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:51:59.502884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c0368d07-2e40-497f-a41f-5e602436d89d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1210 microversion: 2.1 time: 0.167596 May 16 18:51:59.504433 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 245/479] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:59 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1210 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:51:59.869899 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0c554ad1-f6c9-4607-b9b6-503028e59536 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:51:59.871774 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0c554ad1-f6c9-4607-b9b6-503028e59536 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:51:59.885956 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0c554ad1-f6c9-4607-b9b6-503028e59536 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:59.886960 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0c554ad1-f6c9-4607-b9b6-503028e59536 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:51:59.888545 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0c554ad1-f6c9-4607-b9b6-503028e59536 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:51:59.889707 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0c554ad1-f6c9-4607-b9b6-503028e59536 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:00.151248 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0c554ad1-f6c9-4607-b9b6-503028e59536 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:00.162707 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0c554ad1-f6c9-4607-b9b6-503028e59536 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.299856 May 16 18:52:00.163307 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 235/480] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:51:59 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:00.314063 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ff909758-3c34-4ec4-b2e6-3b729a9902c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:00.315228 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ff909758-3c34-4ec4-b2e6-3b729a9902c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:00.335101 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ff909758-3c34-4ec4-b2e6-3b729a9902c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:00.346801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ff909758-3c34-4ec4-b2e6-3b729a9902c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:00.358170 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ff909758-3c34-4ec4-b2e6-3b729a9902c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:00.361303 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ff909758-3c34-4ec4-b2e6-3b729a9902c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:00.530653 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-eec6991a-9c43-4600-adc7-e4516aea2fb9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:00.532100 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-eec6991a-9c43-4600-adc7-e4516aea2fb9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:00.558838 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eec6991a-9c43-4600-adc7-e4516aea2fb9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:00.560228 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eec6991a-9c43-4600-adc7-e4516aea2fb9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:00.568600 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eec6991a-9c43-4600-adc7-e4516aea2fb9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:00.569646 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eec6991a-9c43-4600-adc7-e4516aea2fb9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:00.784075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-eec6991a-9c43-4600-adc7-e4516aea2fb9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:00.796680 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-eec6991a-9c43-4600-adc7-e4516aea2fb9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1210 microversion: 2.1 time: 0.272058 May 16 18:52:00.800861 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 236/481] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:00 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1210 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:00.921102 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ff909758-3c34-4ec4-b2e6-3b729a9902c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:00.944611 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ff909758-3c34-4ec4-b2e6-3b729a9902c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:00.958365 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ff909758-3c34-4ec4-b2e6-3b729a9902c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:00.960678 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ff909758-3c34-4ec4-b2e6-3b729a9902c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.653214 May 16 18:52:00.965595 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 246/482] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:00 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:01.189001 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d47adc95-5581-4519-af16-0e17a8d50e31 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:01.190339 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d47adc95-5581-4519-af16-0e17a8d50e31 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:01.209063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d47adc95-5581-4519-af16-0e17a8d50e31 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:01.210435 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d47adc95-5581-4519-af16-0e17a8d50e31 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:01.212490 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d47adc95-5581-4519-af16-0e17a8d50e31 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:01.213397 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d47adc95-5581-4519-af16-0e17a8d50e31 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:01.457900 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d47adc95-5581-4519-af16-0e17a8d50e31 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:01.472320 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d47adc95-5581-4519-af16-0e17a8d50e31 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.289227 May 16 18:52:01.473566 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 237/483] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:01 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:01.825006 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8b63db6d-5811-4c96-a8fe-2f4a21b3e902 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:01.830720 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8b63db6d-5811-4c96-a8fe-2f4a21b3e902 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:01.840454 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8b63db6d-5811-4c96-a8fe-2f4a21b3e902 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:01.841363 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8b63db6d-5811-4c96-a8fe-2f4a21b3e902 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:01.843691 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8b63db6d-5811-4c96-a8fe-2f4a21b3e902 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:01.844593 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8b63db6d-5811-4c96-a8fe-2f4a21b3e902 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:01.997142 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-01dcfa67-210b-47b7-976c-e2b91467f633 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:01.998374 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-01dcfa67-210b-47b7-976c-e2b91467f633 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:02.013373 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-01dcfa67-210b-47b7-976c-e2b91467f633 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:02.014243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-01dcfa67-210b-47b7-976c-e2b91467f633 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:02.015674 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-01dcfa67-210b-47b7-976c-e2b91467f633 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:02.016789 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-01dcfa67-210b-47b7-976c-e2b91467f633 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:02.075922 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8b63db6d-5811-4c96-a8fe-2f4a21b3e902 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:02.103756 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8b63db6d-5811-4c96-a8fe-2f4a21b3e902 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.284219 May 16 18:52:02.105247 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 247/484] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:01 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:02.277488 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-01dcfa67-210b-47b7-976c-e2b91467f633 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:02.302809 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-01dcfa67-210b-47b7-976c-e2b91467f633 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:02.306343 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-01dcfa67-210b-47b7-976c-e2b91467f633 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:02.317872 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-01dcfa67-210b-47b7-976c-e2b91467f633 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.328277 May 16 18:52:02.332687 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 238/485] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:01 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:02.503567 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b86b1e16-34b4-4596-8e1f-4b1ceb6131c8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:02.505984 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b86b1e16-34b4-4596-8e1f-4b1ceb6131c8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:02.534053 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b86b1e16-34b4-4596-8e1f-4b1ceb6131c8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:02.539659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b86b1e16-34b4-4596-8e1f-4b1ceb6131c8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:02.543492 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b86b1e16-34b4-4596-8e1f-4b1ceb6131c8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:02.544456 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b86b1e16-34b4-4596-8e1f-4b1ceb6131c8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:02.973388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b86b1e16-34b4-4596-8e1f-4b1ceb6131c8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:02.989233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b86b1e16-34b4-4596-8e1f-4b1ceb6131c8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.492813 May 16 18:52:02.991162 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 248/486] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:02 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:03.126654 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d2bed5e3-47cd-4549-8984-a5d6fc60b864 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:03.127520 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d2bed5e3-47cd-4549-8984-a5d6fc60b864 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:03.150180 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d2bed5e3-47cd-4549-8984-a5d6fc60b864 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:03.150625 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d2bed5e3-47cd-4549-8984-a5d6fc60b864 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:03.151702 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d2bed5e3-47cd-4549-8984-a5d6fc60b864 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:03.152169 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d2bed5e3-47cd-4549-8984-a5d6fc60b864 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:03.352325 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e2ff74cd-a861-49d3-b6d8-bc29046bd45c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:03.352929 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-e2ff74cd-a861-49d3-b6d8-bc29046bd45c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:03.366823 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e2ff74cd-a861-49d3-b6d8-bc29046bd45c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:03.367468 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e2ff74cd-a861-49d3-b6d8-bc29046bd45c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:03.368064 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e2ff74cd-a861-49d3-b6d8-bc29046bd45c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:03.368501 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e2ff74cd-a861-49d3-b6d8-bc29046bd45c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:03.398716 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d2bed5e3-47cd-4549-8984-a5d6fc60b864 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:03.427159 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d2bed5e3-47cd-4549-8984-a5d6fc60b864 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.305486 May 16 18:52:03.430486 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 239/487] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:03 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:03.638037 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e2ff74cd-a861-49d3-b6d8-bc29046bd45c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:03.662898 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e2ff74cd-a861-49d3-b6d8-bc29046bd45c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:03.666296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e2ff74cd-a861-49d3-b6d8-bc29046bd45c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:03.682580 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e2ff74cd-a861-49d3-b6d8-bc29046bd45c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.320887 May 16 18:52:03.685365 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 249/488] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:03 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:03.957431 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-961ef80f-cb29-443e-a1e5-5e03f22b7823 req-268fa91a-b769-4e75-848e-1996b04c45d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9f61265-a9db-48ea-a142-5238bf17239d", "tag": "3ba065e3-302f-4b58-b666-92ac520ffc00"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:03.992317 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-961ef80f-cb29-443e-a1e5-5e03f22b7823 req-268fa91a-b769-4e75-848e-1996b04c45d4 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:03.994818 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-961ef80f-cb29-443e-a1e5-5e03f22b7823 req-268fa91a-b769-4e75-848e-1996b04c45d4 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:04.015735 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-961ef80f-cb29-443e-a1e5-5e03f22b7823 req-268fa91a-b769-4e75-848e-1996b04c45d4 service nova] Creating event network-changed:3ba065e3-302f-4b58-b666-92ac520ffc00 for instance f9f61265-a9db-48ea-a142-5238bf17239d on hv-cinder-75078 May 16 18:52:04.017575 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9c187f90-809a-4020-ace3-a26c50f07fa3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:04.019335 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9c187f90-809a-4020-ace3-a26c50f07fa3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:04.022349 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-961ef80f-cb29-443e-a1e5-5e03f22b7823 req-268fa91a-b769-4e75-848e-1996b04c45d4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071503 May 16 18:52:04.023243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 240/489] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:52:04.033497 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c187f90-809a-4020-ace3-a26c50f07fa3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:04.034099 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c187f90-809a-4020-ace3-a26c50f07fa3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:04.034821 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c187f90-809a-4020-ace3-a26c50f07fa3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:04.035293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c187f90-809a-4020-ace3-a26c50f07fa3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:04.322947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9c187f90-809a-4020-ace3-a26c50f07fa3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:04.344250 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9c187f90-809a-4020-ace3-a26c50f07fa3 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.334061 May 16 18:52:04.345479 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 250/490] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:04 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:04.464210 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7af14d9d-4fa5-4f64-8d52-e25c3eccaea9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:04.465444 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7af14d9d-4fa5-4f64-8d52-e25c3eccaea9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:04.489495 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7af14d9d-4fa5-4f64-8d52-e25c3eccaea9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:04.490268 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7af14d9d-4fa5-4f64-8d52-e25c3eccaea9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:04.501581 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7af14d9d-4fa5-4f64-8d52-e25c3eccaea9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:04.502341 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7af14d9d-4fa5-4f64-8d52-e25c3eccaea9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:04.710219 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3d4fe3cf-b0d7-4d2c-85de-0210794e3995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:04.715586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3d4fe3cf-b0d7-4d2c-85de-0210794e3995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:04.758867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d4fe3cf-b0d7-4d2c-85de-0210794e3995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:04.761788 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d4fe3cf-b0d7-4d2c-85de-0210794e3995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:04.763610 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d4fe3cf-b0d7-4d2c-85de-0210794e3995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:04.773313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d4fe3cf-b0d7-4d2c-85de-0210794e3995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:04.819162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7af14d9d-4fa5-4f64-8d52-e25c3eccaea9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:04.848670 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7af14d9d-4fa5-4f64-8d52-e25c3eccaea9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.395798 May 16 18:52:04.852589 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 241/491] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:04 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:05.191270 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3d4fe3cf-b0d7-4d2c-85de-0210794e3995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:05.219488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3d4fe3cf-b0d7-4d2c-85de-0210794e3995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:05.224260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3d4fe3cf-b0d7-4d2c-85de-0210794e3995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:05.226599 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3d4fe3cf-b0d7-4d2c-85de-0210794e3995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.526071 May 16 18:52:05.227611 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 251/492] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:04 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:05.376640 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8f8937a2-42f6-4a9d-991f-6309474a94bb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:05.379171 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8f8937a2-42f6-4a9d-991f-6309474a94bb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:05.453269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8f8937a2-42f6-4a9d-991f-6309474a94bb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:05.457879 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8f8937a2-42f6-4a9d-991f-6309474a94bb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:05.461005 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8f8937a2-42f6-4a9d-991f-6309474a94bb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:05.462764 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8f8937a2-42f6-4a9d-991f-6309474a94bb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:05.881291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8f5d9b59-2135-4c41-ac02-05f6c894d10d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:05.882489 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8f5d9b59-2135-4c41-ac02-05f6c894d10d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:05.902431 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8f5d9b59-2135-4c41-ac02-05f6c894d10d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:05.903600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8f5d9b59-2135-4c41-ac02-05f6c894d10d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:05.904908 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8f5d9b59-2135-4c41-ac02-05f6c894d10d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:05.905827 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8f5d9b59-2135-4c41-ac02-05f6c894d10d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:05.994205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8f8937a2-42f6-4a9d-991f-6309474a94bb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:06.031581 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8f8937a2-42f6-4a9d-991f-6309474a94bb tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1501 microversion: 2.1 time: 0.664102 May 16 18:52:06.046026 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 242/493] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:05 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1501 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:06.062883 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9d9c26a3-d0e1-4208-a718-23d128210307 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "791a2506-1155-47c9-b360-a837c9027c3e"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:06.078842 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9d9c26a3-d0e1-4208-a718-23d128210307 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:06.096986 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9d9c26a3-d0e1-4208-a718-23d128210307 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:06.098098 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9d9c26a3-d0e1-4208-a718-23d128210307 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:06.099683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9d9c26a3-d0e1-4208-a718-23d128210307 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:06.105585 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9d9c26a3-d0e1-4208-a718-23d128210307 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:06.171916 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-9d9c26a3-d0e1-4208-a718-23d128210307 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] HTTP exception thrown: Cannot 'attach_volume' instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac while it is in vm_state rescued May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9d9c26a3-d0e1-4208-a718-23d128210307 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Request method failure captured: May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: POST /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac/os-volume_attachments HTTP/1.1 May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 74 May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpzg_Pwgwncj8s5c-vohUPtNAuGaR132lrZYw_aU8QzfdorNmdIes6ufMp_OpEpKC8RJG-tNmWB2qOSEHIYoYS2_ry6eMVKghmNBWXn50nOzP_tfjsnxTAesZPSPNnVmxEieajJZdqMpkVwbQctsn13iD0NMbnMI0cGFqADMHG_Pgqw May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 9fe0e3c0f5eb4d4199f084be233eb1d3 May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:52:06.176681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 9fe0e3c0f5eb4d4199f084be233eb1d3 May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-ServerRescueNegativeTestJSON-130323987-project May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 89539508b327427ba1a449fe30569606 May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-130323987-project May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {"volumeAttachment": {"volumeId": "791a2506-1155-47c9-b360-a837c9027c3e"}} May 16 18:52:06.180149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Cannot 'attach_volume' instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac while it is in vm_state rescued May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'server_id': 'a2573d57-ebb1-4daf-8809-cdc7c0d32eac', 'body': {'volumeAttachment': {'volumeId': '791a2506-1155-47c9-b360-a837c9027c3e'}}} May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac in vm_state rescued. Cannot attach_volume while the instance is in this state. May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:52:06.182252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac while it is in vm_state rescued May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:52:06.192229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:52:06.194468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:52:06.194468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:52:06.194468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac while it is in vm_state rescued May 16 18:52:06.194468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:52:06.194468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9d9c26a3-d0e1-4208-a718-23d128210307 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Returning 409 to user: Cannot 'attach_volume' instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac while it is in vm_state rescued {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:52:06.194468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9d9c26a3-d0e1-4208-a718-23d128210307 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.124881 May 16 18:52:06.194468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 243/494] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:52:06 2022] POST /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac/os-volume_attachments => generated 152 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 18:52:06.205043 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-947e4035-68b3-4491-afc9-9b0aae0afbed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:06.205882 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-947e4035-68b3-4491-afc9-9b0aae0afbed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:06.224964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-947e4035-68b3-4491-afc9-9b0aae0afbed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:06.226231 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-947e4035-68b3-4491-afc9-9b0aae0afbed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:06.228062 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-947e4035-68b3-4491-afc9-9b0aae0afbed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:06.229235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-947e4035-68b3-4491-afc9-9b0aae0afbed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:06.334712 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8f5d9b59-2135-4c41-ac02-05f6c894d10d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:06.354731 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8f5d9b59-2135-4c41-ac02-05f6c894d10d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.484995 May 16 18:52:06.370936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 252/495] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:05 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:06.380708 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6109331e-4018-4aec-8041-502a6840f3c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:06.382030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6109331e-4018-4aec-8041-502a6840f3c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:06.393350 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6109331e-4018-4aec-8041-502a6840f3c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:06.394270 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6109331e-4018-4aec-8041-502a6840f3c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:06.395672 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6109331e-4018-4aec-8041-502a6840f3c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:06.397484 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6109331e-4018-4aec-8041-502a6840f3c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:06.432631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-947e4035-68b3-4491-afc9-9b0aae0afbed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac/action" status: 202 len: 0 microversion: 2.1 time: 0.234349 May 16 18:52:06.445045 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 244/496] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:52:06 2022] POST /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:52:06.459146 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-86cdb387-960b-4709-a1de-bd90aed641f6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:06.461174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-86cdb387-960b-4709-a1de-bd90aed641f6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:06.475406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86cdb387-960b-4709-a1de-bd90aed641f6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:06.476763 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86cdb387-960b-4709-a1de-bd90aed641f6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:06.478274 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86cdb387-960b-4709-a1de-bd90aed641f6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:06.479942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86cdb387-960b-4709-a1de-bd90aed641f6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:06.762316 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-86cdb387-960b-4709-a1de-bd90aed641f6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:06.794331 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6109331e-4018-4aec-8041-502a6840f3c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:06.797724 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-86cdb387-960b-4709-a1de-bd90aed641f6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.348701 May 16 18:52:06.798821 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 245/497] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:06 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:06.820824 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6109331e-4018-4aec-8041-502a6840f3c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:06.825839 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6109331e-4018-4aec-8041-502a6840f3c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:06.827133 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6109331e-4018-4aec-8041-502a6840f3c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.454318 May 16 18:52:06.828071 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 253/498] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:06 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:07.404826 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4670ba52-fc0b-4dae-a6ed-526d19e9e1ff tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:07.406898 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4670ba52-fc0b-4dae-a6ed-526d19e9e1ff tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:07.417453 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4670ba52-fc0b-4dae-a6ed-526d19e9e1ff tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:07.418188 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4670ba52-fc0b-4dae-a6ed-526d19e9e1ff tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:07.419529 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4670ba52-fc0b-4dae-a6ed-526d19e9e1ff tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:07.420863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4670ba52-fc0b-4dae-a6ed-526d19e9e1ff tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:07.683984 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4670ba52-fc0b-4dae-a6ed-526d19e9e1ff tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:07.700020 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4670ba52-fc0b-4dae-a6ed-526d19e9e1ff tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.312398 May 16 18:52:07.711801 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 246/499] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:07 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:07.820915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-fcbdccfa-9afc-4cfa-8970-c0d98dac8e99 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:07.822224 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-fcbdccfa-9afc-4cfa-8970-c0d98dac8e99 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:07.830852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fcbdccfa-9afc-4cfa-8970-c0d98dac8e99 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:07.831332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fcbdccfa-9afc-4cfa-8970-c0d98dac8e99 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:07.832174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fcbdccfa-9afc-4cfa-8970-c0d98dac8e99 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:07.832835 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fcbdccfa-9afc-4cfa-8970-c0d98dac8e99 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:07.855354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5099b84f-b80a-4c69-ae09-ed2da850544a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:07.855955 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5099b84f-b80a-4c69-ae09-ed2da850544a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:07.868387 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5099b84f-b80a-4c69-ae09-ed2da850544a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:07.869797 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5099b84f-b80a-4c69-ae09-ed2da850544a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:07.871671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5099b84f-b80a-4c69-ae09-ed2da850544a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:07.872882 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5099b84f-b80a-4c69-ae09-ed2da850544a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:08.231063 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-fcbdccfa-9afc-4cfa-8970-c0d98dac8e99 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:08.241207 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5099b84f-b80a-4c69-ae09-ed2da850544a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:08.261288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-fcbdccfa-9afc-4cfa-8970-c0d98dac8e99 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.447468 May 16 18:52:08.262174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 254/500] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:07 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:08.266179 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5099b84f-b80a-4c69-ae09-ed2da850544a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:08.267898 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5099b84f-b80a-4c69-ae09-ed2da850544a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:08.269380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5099b84f-b80a-4c69-ae09-ed2da850544a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.422504 May 16 18:52:08.270066 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 247/501] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:07 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:08.735692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-69708841-89ee-4cee-91c9-2138077f5d07 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:08.737091 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-69708841-89ee-4cee-91c9-2138077f5d07 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:08.747153 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69708841-89ee-4cee-91c9-2138077f5d07 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:08.748950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69708841-89ee-4cee-91c9-2138077f5d07 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:08.750714 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69708841-89ee-4cee-91c9-2138077f5d07 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:08.751849 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69708841-89ee-4cee-91c9-2138077f5d07 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:09.148778 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-69708841-89ee-4cee-91c9-2138077f5d07 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:09.167232 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-69708841-89ee-4cee-91c9-2138077f5d07 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.437512 May 16 18:52:09.172011 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 255/502] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:08 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:09.310177 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f9d35555-94e5-461c-97d0-a707148b656c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:09.313242 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f9d35555-94e5-461c-97d0-a707148b656c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:09.316355 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-23e20240-b7df-4423-9ea6-1ffca67f16fb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:09.318445 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-23e20240-b7df-4423-9ea6-1ffca67f16fb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:09.346426 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-23e20240-b7df-4423-9ea6-1ffca67f16fb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:09.349178 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-23e20240-b7df-4423-9ea6-1ffca67f16fb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:09.353959 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-23e20240-b7df-4423-9ea6-1ffca67f16fb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:09.355098 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-23e20240-b7df-4423-9ea6-1ffca67f16fb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:09.370041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9d35555-94e5-461c-97d0-a707148b656c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:09.374779 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9d35555-94e5-461c-97d0-a707148b656c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:09.376821 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9d35555-94e5-461c-97d0-a707148b656c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:09.378969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f9d35555-94e5-461c-97d0-a707148b656c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:09.735423 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-23e20240-b7df-4423-9ea6-1ffca67f16fb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:09.751531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-23e20240-b7df-4423-9ea6-1ffca67f16fb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:09.754665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-23e20240-b7df-4423-9ea6-1ffca67f16fb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:09.762813 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-23e20240-b7df-4423-9ea6-1ffca67f16fb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.457680 May 16 18:52:09.787362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 256/503] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:09 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:09.799933 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f9d35555-94e5-461c-97d0-a707148b656c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:09.820754 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f9d35555-94e5-461c-97d0-a707148b656c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.517347 May 16 18:52:09.834067 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 248/504] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:09 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:10.194436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ad79652b-f6d5-4a01-904b-3dad9b6dad9e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:10.195354 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ad79652b-f6d5-4a01-904b-3dad9b6dad9e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:10.217505 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ad79652b-f6d5-4a01-904b-3dad9b6dad9e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:10.218676 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ad79652b-f6d5-4a01-904b-3dad9b6dad9e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:10.220213 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ad79652b-f6d5-4a01-904b-3dad9b6dad9e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:10.220950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ad79652b-f6d5-4a01-904b-3dad9b6dad9e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:10.559015 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ad79652b-f6d5-4a01-904b-3dad9b6dad9e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:10.585127 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ad79652b-f6d5-4a01-904b-3dad9b6dad9e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.397453 May 16 18:52:10.586400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 257/505] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:10 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:10.798955 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d7b421f8-05d2-4890-be8f-a75881411e1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:10.801176 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d7b421f8-05d2-4890-be8f-a75881411e1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:10.820556 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d7b421f8-05d2-4890-be8f-a75881411e1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:10.821840 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d7b421f8-05d2-4890-be8f-a75881411e1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:10.823748 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d7b421f8-05d2-4890-be8f-a75881411e1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:10.836877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d7b421f8-05d2-4890-be8f-a75881411e1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:10.847914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-72819e9a-8fe1-4b02-8d27-8453df190676 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:10.852666 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-72819e9a-8fe1-4b02-8d27-8453df190676 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:10.865388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-72819e9a-8fe1-4b02-8d27-8453df190676 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:10.866506 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-72819e9a-8fe1-4b02-8d27-8453df190676 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:10.867972 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-72819e9a-8fe1-4b02-8d27-8453df190676 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:10.870076 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-72819e9a-8fe1-4b02-8d27-8453df190676 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:11.270686 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-72819e9a-8fe1-4b02-8d27-8453df190676 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:11.291737 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d7b421f8-05d2-4890-be8f-a75881411e1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:11.291962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-72819e9a-8fe1-4b02-8d27-8453df190676 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.452645 May 16 18:52:11.293272 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 258/506] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:10 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:11.311484 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d7b421f8-05d2-4890-be8f-a75881411e1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:11.314379 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d7b421f8-05d2-4890-be8f-a75881411e1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:11.316435 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d7b421f8-05d2-4890-be8f-a75881411e1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.524595 May 16 18:52:11.317386 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 249/507] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:10 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:11.611048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-280d1fc4-6d83-479b-9c54-633ff26d498d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:11.611741 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-280d1fc4-6d83-479b-9c54-633ff26d498d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:11.622166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-280d1fc4-6d83-479b-9c54-633ff26d498d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:11.624436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-280d1fc4-6d83-479b-9c54-633ff26d498d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:11.626347 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-280d1fc4-6d83-479b-9c54-633ff26d498d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:11.627527 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-280d1fc4-6d83-479b-9c54-633ff26d498d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:11.873804 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-280d1fc4-6d83-479b-9c54-633ff26d498d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:11.896248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-280d1fc4-6d83-479b-9c54-633ff26d498d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.290581 May 16 18:52:11.897295 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 259/508] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:11 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:12.318130 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-44ecf4e8-560f-479b-8d8a-36a4ba212794 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:12.318844 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-44ecf4e8-560f-479b-8d8a-36a4ba212794 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:12.325586 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-44ecf4e8-560f-479b-8d8a-36a4ba212794 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:12.326126 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-44ecf4e8-560f-479b-8d8a-36a4ba212794 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:12.327659 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-44ecf4e8-560f-479b-8d8a-36a4ba212794 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:12.328137 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-44ecf4e8-560f-479b-8d8a-36a4ba212794 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:12.347662 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bd562be1-c011-4ddd-bcd5-160335f5856b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:12.349039 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-bd562be1-c011-4ddd-bcd5-160335f5856b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:12.358818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bd562be1-c011-4ddd-bcd5-160335f5856b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:12.359942 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bd562be1-c011-4ddd-bcd5-160335f5856b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:12.361085 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bd562be1-c011-4ddd-bcd5-160335f5856b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:12.361803 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bd562be1-c011-4ddd-bcd5-160335f5856b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:12.620828 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-44ecf4e8-560f-479b-8d8a-36a4ba212794 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:12.630582 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-44ecf4e8-560f-479b-8d8a-36a4ba212794 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.316483 May 16 18:52:12.634866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 250/509] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:12 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:12.639561 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bd562be1-c011-4ddd-bcd5-160335f5856b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:12.649367 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bd562be1-c011-4ddd-bcd5-160335f5856b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:12.650998 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bd562be1-c011-4ddd-bcd5-160335f5856b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:12.652309 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-bd562be1-c011-4ddd-bcd5-160335f5856b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.310858 May 16 18:52:12.652953 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 260/510] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:12 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:12.919900 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c0898015-c803-49b2-bae4-8337246f59e8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:12.920997 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c0898015-c803-49b2-bae4-8337246f59e8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:12.935737 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c0898015-c803-49b2-bae4-8337246f59e8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:12.935737 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c0898015-c803-49b2-bae4-8337246f59e8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:12.935737 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c0898015-c803-49b2-bae4-8337246f59e8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:12.935737 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c0898015-c803-49b2-bae4-8337246f59e8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:13.125226 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c0898015-c803-49b2-bae4-8337246f59e8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:13.133232 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c0898015-c803-49b2-bae4-8337246f59e8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.217209 May 16 18:52:13.133858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 251/511] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:12 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:13.648213 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-dcf9c8c7-ece7-431d-bce5-e745ce4c74c0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:13.648835 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-dcf9c8c7-ece7-431d-bce5-e745ce4c74c0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:13.658185 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dcf9c8c7-ece7-431d-bce5-e745ce4c74c0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:13.659230 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dcf9c8c7-ece7-431d-bce5-e745ce4c74c0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:13.659515 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dcf9c8c7-ece7-431d-bce5-e745ce4c74c0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:13.660086 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dcf9c8c7-ece7-431d-bce5-e745ce4c74c0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:13.676409 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d6826e34-c4ae-4d81-abbc-d5be167922db tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:13.677740 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d6826e34-c4ae-4d81-abbc-d5be167922db tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:13.690480 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d6826e34-c4ae-4d81-abbc-d5be167922db tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:13.691963 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d6826e34-c4ae-4d81-abbc-d5be167922db tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:13.693514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d6826e34-c4ae-4d81-abbc-d5be167922db tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:13.694306 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d6826e34-c4ae-4d81-abbc-d5be167922db tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:13.897764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dcf9c8c7-ece7-431d-bce5-e745ce4c74c0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:13.939205 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-dcf9c8c7-ece7-431d-bce5-e745ce4c74c0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.294151 May 16 18:52:13.941780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 261/512] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:13 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:13.986560 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d6826e34-c4ae-4d81-abbc-d5be167922db tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:14.012263 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d6826e34-c4ae-4d81-abbc-d5be167922db tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:14.015906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d6826e34-c4ae-4d81-abbc-d5be167922db tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:14.018554 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d6826e34-c4ae-4d81-abbc-d5be167922db tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.350687 May 16 18:52:14.020040 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 252/513] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:13 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:14.163171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3e4681a8-5e9e-45ad-926a-70278a4007bc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:14.164306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3e4681a8-5e9e-45ad-926a-70278a4007bc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:14.174811 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3e4681a8-5e9e-45ad-926a-70278a4007bc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:14.175655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3e4681a8-5e9e-45ad-926a-70278a4007bc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:14.176586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3e4681a8-5e9e-45ad-926a-70278a4007bc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:14.177036 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3e4681a8-5e9e-45ad-926a-70278a4007bc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:14.369005 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3e4681a8-5e9e-45ad-926a-70278a4007bc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:14.384258 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3e4681a8-5e9e-45ad-926a-70278a4007bc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.228299 May 16 18:52:14.385404 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 262/514] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:14 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:14.962624 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2b1941dc-8f62-4be7-a584-9abd281065d8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:14.963759 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2b1941dc-8f62-4be7-a584-9abd281065d8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:14.975466 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2b1941dc-8f62-4be7-a584-9abd281065d8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:14.976295 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2b1941dc-8f62-4be7-a584-9abd281065d8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:14.977643 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2b1941dc-8f62-4be7-a584-9abd281065d8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:14.978417 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2b1941dc-8f62-4be7-a584-9abd281065d8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:15.051785 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-917fbdb4-5691-4b53-b54c-735cad4a2bd2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:15.052700 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-917fbdb4-5691-4b53-b54c-735cad4a2bd2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:15.061350 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-917fbdb4-5691-4b53-b54c-735cad4a2bd2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:15.061975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-917fbdb4-5691-4b53-b54c-735cad4a2bd2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:15.063271 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-917fbdb4-5691-4b53-b54c-735cad4a2bd2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:15.064020 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-917fbdb4-5691-4b53-b54c-735cad4a2bd2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:15.239469 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2b1941dc-8f62-4be7-a584-9abd281065d8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:15.259128 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2b1941dc-8f62-4be7-a584-9abd281065d8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.303165 May 16 18:52:15.260690 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 253/515] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:14 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:15.360407 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-917fbdb4-5691-4b53-b54c-735cad4a2bd2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:15.384588 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-917fbdb4-5691-4b53-b54c-735cad4a2bd2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:15.388000 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-917fbdb4-5691-4b53-b54c-735cad4a2bd2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:15.390902 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-917fbdb4-5691-4b53-b54c-735cad4a2bd2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.344561 May 16 18:52:15.395181 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 263/516] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:15 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:15.420061 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-53a22a49-681e-4ea3-962d-e054e3846fe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:15.420885 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-53a22a49-681e-4ea3-962d-e054e3846fe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:15.431261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-53a22a49-681e-4ea3-962d-e054e3846fe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:15.432076 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-53a22a49-681e-4ea3-962d-e054e3846fe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:15.433496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-53a22a49-681e-4ea3-962d-e054e3846fe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:15.434512 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-53a22a49-681e-4ea3-962d-e054e3846fe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:15.701406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-53a22a49-681e-4ea3-962d-e054e3846fe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:15.716194 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-53a22a49-681e-4ea3-962d-e054e3846fe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.305204 May 16 18:52:15.719505 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 254/517] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:15 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:16.290035 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e8180ee0-7885-456c-9a5b-897f4aa7e776 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:16.291109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-e8180ee0-7885-456c-9a5b-897f4aa7e776 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:16.303772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e8180ee0-7885-456c-9a5b-897f4aa7e776 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:16.304534 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e8180ee0-7885-456c-9a5b-897f4aa7e776 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:16.305896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e8180ee0-7885-456c-9a5b-897f4aa7e776 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:16.306654 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e8180ee0-7885-456c-9a5b-897f4aa7e776 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:16.416883 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0aa6d27f-91b3-4374-9899-7dce51349896 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:16.419119 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0aa6d27f-91b3-4374-9899-7dce51349896 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:16.430777 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0aa6d27f-91b3-4374-9899-7dce51349896 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:16.431250 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0aa6d27f-91b3-4374-9899-7dce51349896 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:16.437230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0aa6d27f-91b3-4374-9899-7dce51349896 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:16.437676 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0aa6d27f-91b3-4374-9899-7dce51349896 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:16.686902 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e8180ee0-7885-456c-9a5b-897f4aa7e776 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:16.707005 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e8180ee0-7885-456c-9a5b-897f4aa7e776 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.424127 May 16 18:52:16.709048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 264/518] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:16 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:16.736174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0aa6d27f-91b3-4374-9899-7dce51349896 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:16.746457 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4ee99d8e-dc68-465b-84bd-d63dc6894102 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:16.747584 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-4ee99d8e-dc68-465b-84bd-d63dc6894102 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:16.757703 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ee99d8e-dc68-465b-84bd-d63dc6894102 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:16.759334 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ee99d8e-dc68-465b-84bd-d63dc6894102 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:16.760805 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ee99d8e-dc68-465b-84bd-d63dc6894102 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:16.761433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0aa6d27f-91b3-4374-9899-7dce51349896 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:16.761628 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ee99d8e-dc68-465b-84bd-d63dc6894102 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:16.763329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0aa6d27f-91b3-4374-9899-7dce51349896 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:16.765972 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0aa6d27f-91b3-4374-9899-7dce51349896 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.353667 May 16 18:52:16.781271 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 255/519] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:16 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:17.020125 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-4ee99d8e-dc68-465b-84bd-d63dc6894102 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:17.035391 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-4ee99d8e-dc68-465b-84bd-d63dc6894102 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.297658 May 16 18:52:17.036425 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 265/520] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:16 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:17.735271 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1e25269f-c3b2-4c9e-aab9-dca0b4c12e7a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:17.736682 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1e25269f-c3b2-4c9e-aab9-dca0b4c12e7a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:17.744195 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e25269f-c3b2-4c9e-aab9-dca0b4c12e7a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:17.744976 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e25269f-c3b2-4c9e-aab9-dca0b4c12e7a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:17.745996 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e25269f-c3b2-4c9e-aab9-dca0b4c12e7a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:17.746626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1e25269f-c3b2-4c9e-aab9-dca0b4c12e7a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:17.793588 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7120bdfe-5ef5-4a4a-be02-f50e0975e491 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:17.795225 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7120bdfe-5ef5-4a4a-be02-f50e0975e491 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:17.805357 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7120bdfe-5ef5-4a4a-be02-f50e0975e491 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:17.805977 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7120bdfe-5ef5-4a4a-be02-f50e0975e491 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:17.806955 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7120bdfe-5ef5-4a4a-be02-f50e0975e491 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:17.807396 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7120bdfe-5ef5-4a4a-be02-f50e0975e491 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:18.071141 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1e25269f-c3b2-4c9e-aab9-dca0b4c12e7a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:18.088967 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1e25269f-c3b2-4c9e-aab9-dca0b4c12e7a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.361269 May 16 18:52:18.095768 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 256/521] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:17 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:18.113017 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1179050f-be9a-49d8-a2cf-568c55ef6e1d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:18.114175 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1179050f-be9a-49d8-a2cf-568c55ef6e1d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:18.134861 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1179050f-be9a-49d8-a2cf-568c55ef6e1d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:18.135841 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1179050f-be9a-49d8-a2cf-568c55ef6e1d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:18.137429 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1179050f-be9a-49d8-a2cf-568c55ef6e1d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:18.139906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1179050f-be9a-49d8-a2cf-568c55ef6e1d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:18.179537 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7120bdfe-5ef5-4a4a-be02-f50e0975e491 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:18.191887 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7120bdfe-5ef5-4a4a-be02-f50e0975e491 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:18.193448 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7120bdfe-5ef5-4a4a-be02-f50e0975e491 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:18.195313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7120bdfe-5ef5-4a4a-be02-f50e0975e491 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.408735 May 16 18:52:18.196382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 266/522] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:17 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:18.353616 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1179050f-be9a-49d8-a2cf-568c55ef6e1d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:18.363123 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1179050f-be9a-49d8-a2cf-568c55ef6e1d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.265768 May 16 18:52:18.363699 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 257/523] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:18 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:19.125495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-85ae3d36-5fed-4e97-a677-21f47d329675 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:19.126475 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-85ae3d36-5fed-4e97-a677-21f47d329675 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:19.141469 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-85ae3d36-5fed-4e97-a677-21f47d329675 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:19.142223 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-85ae3d36-5fed-4e97-a677-21f47d329675 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:19.143950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-85ae3d36-5fed-4e97-a677-21f47d329675 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:19.144713 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-85ae3d36-5fed-4e97-a677-21f47d329675 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:19.233940 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8a9fd577-d9fb-4200-a2ec-55096bba2fdd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:19.235987 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8a9fd577-d9fb-4200-a2ec-55096bba2fdd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:19.248421 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a9fd577-d9fb-4200-a2ec-55096bba2fdd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:19.249649 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a9fd577-d9fb-4200-a2ec-55096bba2fdd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:19.251371 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a9fd577-d9fb-4200-a2ec-55096bba2fdd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:19.252500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a9fd577-d9fb-4200-a2ec-55096bba2fdd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:19.508104 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-85ae3d36-5fed-4e97-a677-21f47d329675 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:19.528511 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-85ae3d36-5fed-4e97-a677-21f47d329675 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.408189 May 16 18:52:19.530306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 267/524] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:19 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:19.539650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d401c399-9e2c-406b-814b-112cef9bb138 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:19.540546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d401c399-9e2c-406b-814b-112cef9bb138 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:19.557148 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d401c399-9e2c-406b-814b-112cef9bb138 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:19.558420 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d401c399-9e2c-406b-814b-112cef9bb138 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:19.560276 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d401c399-9e2c-406b-814b-112cef9bb138 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:19.562263 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d401c399-9e2c-406b-814b-112cef9bb138 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:19.602359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8a9fd577-d9fb-4200-a2ec-55096bba2fdd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:19.615219 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8a9fd577-d9fb-4200-a2ec-55096bba2fdd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:19.624765 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8a9fd577-d9fb-4200-a2ec-55096bba2fdd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:19.627469 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8a9fd577-d9fb-4200-a2ec-55096bba2fdd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.400304 May 16 18:52:19.629345 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 258/525] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:19 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:20.085135 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d401c399-9e2c-406b-814b-112cef9bb138 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:20.104797 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d401c399-9e2c-406b-814b-112cef9bb138 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.571844 May 16 18:52:20.106258 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 268/526] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:19 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:20.558504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-754d879f-22b9-4f06-b44c-2391b2e4daa9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:20.559549 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-754d879f-22b9-4f06-b44c-2391b2e4daa9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:20.570497 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-754d879f-22b9-4f06-b44c-2391b2e4daa9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:20.570950 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-754d879f-22b9-4f06-b44c-2391b2e4daa9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:20.571771 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-754d879f-22b9-4f06-b44c-2391b2e4daa9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:20.572203 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-754d879f-22b9-4f06-b44c-2391b2e4daa9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:20.650472 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a9beeb04-a011-4a18-8347-b825f4535b58 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:20.652357 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a9beeb04-a011-4a18-8347-b825f4535b58 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:20.663704 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a9beeb04-a011-4a18-8347-b825f4535b58 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:20.664628 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a9beeb04-a011-4a18-8347-b825f4535b58 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:20.665908 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a9beeb04-a011-4a18-8347-b825f4535b58 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:20.666695 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a9beeb04-a011-4a18-8347-b825f4535b58 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:20.778696 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-754d879f-22b9-4f06-b44c-2391b2e4daa9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:20.793144 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-754d879f-22b9-4f06-b44c-2391b2e4daa9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.241544 May 16 18:52:20.795289 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 259/527] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:20 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:20.849745 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a9beeb04-a011-4a18-8347-b825f4535b58 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:20.861353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a9beeb04-a011-4a18-8347-b825f4535b58 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:20.863144 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a9beeb04-a011-4a18-8347-b825f4535b58 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:20.864484 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a9beeb04-a011-4a18-8347-b825f4535b58 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.220914 May 16 18:52:20.865370 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 269/528] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:20 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:21.131018 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7ebe6dea-f8b2-41f7-a09e-90b4a5f7af3b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:21.132150 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7ebe6dea-f8b2-41f7-a09e-90b4a5f7af3b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:21.143760 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7ebe6dea-f8b2-41f7-a09e-90b4a5f7af3b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:21.144557 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7ebe6dea-f8b2-41f7-a09e-90b4a5f7af3b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:21.145950 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7ebe6dea-f8b2-41f7-a09e-90b4a5f7af3b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:21.146722 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7ebe6dea-f8b2-41f7-a09e-90b4a5f7af3b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:21.384566 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7ebe6dea-f8b2-41f7-a09e-90b4a5f7af3b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:21.406163 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7ebe6dea-f8b2-41f7-a09e-90b4a5f7af3b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.281946 May 16 18:52:21.407230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 260/529] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:21 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:21.816261 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c0e8d772-6e43-42a6-9cc4-0e008e9a95a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:21.817150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c0e8d772-6e43-42a6-9cc4-0e008e9a95a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:21.827513 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c0e8d772-6e43-42a6-9cc4-0e008e9a95a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:21.828195 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c0e8d772-6e43-42a6-9cc4-0e008e9a95a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:21.829504 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c0e8d772-6e43-42a6-9cc4-0e008e9a95a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:21.830194 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c0e8d772-6e43-42a6-9cc4-0e008e9a95a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:21.884215 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9387c0ff-72d6-4326-bc5e-0487d214f59f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:21.885216 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9387c0ff-72d6-4326-bc5e-0487d214f59f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:21.893020 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9387c0ff-72d6-4326-bc5e-0487d214f59f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:21.893822 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9387c0ff-72d6-4326-bc5e-0487d214f59f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:21.895212 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9387c0ff-72d6-4326-bc5e-0487d214f59f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:21.896809 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9387c0ff-72d6-4326-bc5e-0487d214f59f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:22.062835 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c0e8d772-6e43-42a6-9cc4-0e008e9a95a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:22.075248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c0e8d772-6e43-42a6-9cc4-0e008e9a95a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.263696 May 16 18:52:22.076253 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 270/530] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:21 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:22.104194 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9387c0ff-72d6-4326-bc5e-0487d214f59f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:22.114463 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9387c0ff-72d6-4326-bc5e-0487d214f59f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:22.116030 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9387c0ff-72d6-4326-bc5e-0487d214f59f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:22.117273 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9387c0ff-72d6-4326-bc5e-0487d214f59f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.237238 May 16 18:52:22.117835 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 261/531] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:21 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:22.437527 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-59899855-aca1-4c86-aa77-5b87ed4f89c2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:22.439031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-59899855-aca1-4c86-aa77-5b87ed4f89c2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:22.447656 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-59899855-aca1-4c86-aa77-5b87ed4f89c2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:22.448229 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-59899855-aca1-4c86-aa77-5b87ed4f89c2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:22.448921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-59899855-aca1-4c86-aa77-5b87ed4f89c2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:22.449355 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-59899855-aca1-4c86-aa77-5b87ed4f89c2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:22.673427 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-59899855-aca1-4c86-aa77-5b87ed4f89c2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:22.681274 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-59899855-aca1-4c86-aa77-5b87ed4f89c2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.251464 May 16 18:52:22.681900 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 271/532] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:22 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:23.099019 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-72f3c117-04e5-442b-bc14-9b62d5b12ece tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:23.099650 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-72f3c117-04e5-442b-bc14-9b62d5b12ece tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:23.111172 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-72f3c117-04e5-442b-bc14-9b62d5b12ece tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:23.111630 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-72f3c117-04e5-442b-bc14-9b62d5b12ece tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:23.112418 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-72f3c117-04e5-442b-bc14-9b62d5b12ece tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:23.112860 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-72f3c117-04e5-442b-bc14-9b62d5b12ece tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:23.137774 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9e5002f7-2776-47f0-b897-b8bf009b1c70 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:23.138626 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9e5002f7-2776-47f0-b897-b8bf009b1c70 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:23.149742 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9e5002f7-2776-47f0-b897-b8bf009b1c70 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:23.150292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9e5002f7-2776-47f0-b897-b8bf009b1c70 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:23.151157 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9e5002f7-2776-47f0-b897-b8bf009b1c70 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:23.151672 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9e5002f7-2776-47f0-b897-b8bf009b1c70 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:23.386655 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-72f3c117-04e5-442b-bc14-9b62d5b12ece tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:23.401795 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-72f3c117-04e5-442b-bc14-9b62d5b12ece tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.309633 May 16 18:52:23.402817 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 262/533] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:23 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:23.406984 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9e5002f7-2776-47f0-b897-b8bf009b1c70 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:23.423515 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9e5002f7-2776-47f0-b897-b8bf009b1c70 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:23.425118 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9e5002f7-2776-47f0-b897-b8bf009b1c70 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:23.426319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9e5002f7-2776-47f0-b897-b8bf009b1c70 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.292841 May 16 18:52:23.427090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 272/534] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:23 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:23.702048 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-816e3e6a-8b6d-4310-8bea-47628017f2ca tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:23.702634 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-816e3e6a-8b6d-4310-8bea-47628017f2ca tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:23.709304 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-816e3e6a-8b6d-4310-8bea-47628017f2ca tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:23.709811 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-816e3e6a-8b6d-4310-8bea-47628017f2ca tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:23.710627 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-816e3e6a-8b6d-4310-8bea-47628017f2ca tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:23.711101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-816e3e6a-8b6d-4310-8bea-47628017f2ca tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:23.884844 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-816e3e6a-8b6d-4310-8bea-47628017f2ca tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:23.893900 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-816e3e6a-8b6d-4310-8bea-47628017f2ca tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.197589 May 16 18:52:23.894549 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 263/535] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:23 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:24.433135 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-44ab3b5d-20c5-44e4-a94f-852f106c115c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:24.434354 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-44ab3b5d-20c5-44e4-a94f-852f106c115c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:24.446798 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-44ab3b5d-20c5-44e4-a94f-852f106c115c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:24.448031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-44ab3b5d-20c5-44e4-a94f-852f106c115c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:24.449398 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-44ab3b5d-20c5-44e4-a94f-852f106c115c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:24.450146 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-44ab3b5d-20c5-44e4-a94f-852f106c115c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:24.451141 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-38bb7bc4-0d37-4b51-a0d4-5722a1494186 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:24.453098 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-38bb7bc4-0d37-4b51-a0d4-5722a1494186 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:24.463116 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-38bb7bc4-0d37-4b51-a0d4-5722a1494186 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:24.463905 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-38bb7bc4-0d37-4b51-a0d4-5722a1494186 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:24.467837 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-38bb7bc4-0d37-4b51-a0d4-5722a1494186 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:24.469719 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-38bb7bc4-0d37-4b51-a0d4-5722a1494186 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:24.686663 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-44ab3b5d-20c5-44e4-a94f-852f106c115c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:24.700431 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-44ab3b5d-20c5-44e4-a94f-852f106c115c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.275854 May 16 18:52:24.701952 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 273/536] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:24 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:24.719662 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-38bb7bc4-0d37-4b51-a0d4-5722a1494186 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:24.733704 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-38bb7bc4-0d37-4b51-a0d4-5722a1494186 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:24.735354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-38bb7bc4-0d37-4b51-a0d4-5722a1494186 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:24.737437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-38bb7bc4-0d37-4b51-a0d4-5722a1494186 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.293989 May 16 18:52:24.738370 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 264/537] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:24 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:24.915978 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-668ed367-d118-4b41-a78e-39758459cc69 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:24.916918 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-668ed367-d118-4b41-a78e-39758459cc69 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:24.927017 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-668ed367-d118-4b41-a78e-39758459cc69 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:24.927802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-668ed367-d118-4b41-a78e-39758459cc69 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:24.929090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-668ed367-d118-4b41-a78e-39758459cc69 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:24.929785 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-668ed367-d118-4b41-a78e-39758459cc69 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:25.087501 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-668ed367-d118-4b41-a78e-39758459cc69 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:25.096566 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-668ed367-d118-4b41-a78e-39758459cc69 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.187887 May 16 18:52:25.097215 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 274/538] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:24 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:25.725993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-08e79ac7-a35c-4f2f-833c-9edd897773ed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:25.727041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-08e79ac7-a35c-4f2f-833c-9edd897773ed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:25.736819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-08e79ac7-a35c-4f2f-833c-9edd897773ed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:25.737159 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-08e79ac7-a35c-4f2f-833c-9edd897773ed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:25.737918 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-08e79ac7-a35c-4f2f-833c-9edd897773ed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:25.738360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-08e79ac7-a35c-4f2f-833c-9edd897773ed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:25.763868 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-87e7cc33-3563-44d3-9dcb-85196411a55a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:25.770796 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-87e7cc33-3563-44d3-9dcb-85196411a55a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:25.775881 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-87e7cc33-3563-44d3-9dcb-85196411a55a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:25.776607 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-87e7cc33-3563-44d3-9dcb-85196411a55a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:25.778135 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-87e7cc33-3563-44d3-9dcb-85196411a55a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:25.778877 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-87e7cc33-3563-44d3-9dcb-85196411a55a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:26.022731 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-08e79ac7-a35c-4f2f-833c-9edd897773ed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:26.038726 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-08e79ac7-a35c-4f2f-833c-9edd897773ed tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1509 microversion: 2.1 time: 0.317558 May 16 18:52:26.044960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-87e7cc33-3563-44d3-9dcb-85196411a55a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:26.048485 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 265/539] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:25 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:26.064913 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-87e7cc33-3563-44d3-9dcb-85196411a55a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:26.068168 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-87e7cc33-3563-44d3-9dcb-85196411a55a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:26.069991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-87e7cc33-3563-44d3-9dcb-85196411a55a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.311191 May 16 18:52:26.070954 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 275/540] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:25 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:26.117479 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ad48cb18-9aeb-4a03-acaa-b872545b29b5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:26.118524 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ad48cb18-9aeb-4a03-acaa-b872545b29b5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:26.129525 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad48cb18-9aeb-4a03-acaa-b872545b29b5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:26.130302 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad48cb18-9aeb-4a03-acaa-b872545b29b5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:26.131595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad48cb18-9aeb-4a03-acaa-b872545b29b5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:26.132442 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad48cb18-9aeb-4a03-acaa-b872545b29b5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:26.353484 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ad48cb18-9aeb-4a03-acaa-b872545b29b5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:26.363752 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ad48cb18-9aeb-4a03-acaa-b872545b29b5 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.251992 May 16 18:52:26.364959 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 266/541] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:26 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:27.065594 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d12b4e51-cfd6-4df0-911e-eb7264dea5ec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:27.066319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d12b4e51-cfd6-4df0-911e-eb7264dea5ec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:27.074056 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d12b4e51-cfd6-4df0-911e-eb7264dea5ec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:27.074504 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d12b4e51-cfd6-4df0-911e-eb7264dea5ec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:27.075293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d12b4e51-cfd6-4df0-911e-eb7264dea5ec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:27.076412 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d12b4e51-cfd6-4df0-911e-eb7264dea5ec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:27.099500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d1f8ee9f-d72f-49ca-a623-507a685b3343 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:27.100766 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d1f8ee9f-d72f-49ca-a623-507a685b3343 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:27.107776 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1f8ee9f-d72f-49ca-a623-507a685b3343 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:27.108485 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1f8ee9f-d72f-49ca-a623-507a685b3343 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:27.109433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1f8ee9f-d72f-49ca-a623-507a685b3343 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:27.110107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d1f8ee9f-d72f-49ca-a623-507a685b3343 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:27.328538 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d12b4e51-cfd6-4df0-911e-eb7264dea5ec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:27.341719 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d12b4e51-cfd6-4df0-911e-eb7264dea5ec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1515 microversion: 2.1 time: 0.282128 May 16 18:52:27.344639 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 276/542] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:27 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1515 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:27.352695 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d1f8ee9f-d72f-49ca-a623-507a685b3343 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:27.368084 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d1f8ee9f-d72f-49ca-a623-507a685b3343 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:27.370700 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d1f8ee9f-d72f-49ca-a623-507a685b3343 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:27.373198 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d1f8ee9f-d72f-49ca-a623-507a685b3343 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.276737 May 16 18:52:27.374202 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 267/543] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:27 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:27.404370 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d9076ebc-2d82-46aa-b110-750e29c6eb7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:27.404370 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d9076ebc-2d82-46aa-b110-750e29c6eb7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:27.405988 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d9076ebc-2d82-46aa-b110-750e29c6eb7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:27.406600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d9076ebc-2d82-46aa-b110-750e29c6eb7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:27.407694 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d9076ebc-2d82-46aa-b110-750e29c6eb7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:27.408373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d9076ebc-2d82-46aa-b110-750e29c6eb7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:27.652481 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d9076ebc-2d82-46aa-b110-750e29c6eb7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:27.668174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d9076ebc-2d82-46aa-b110-750e29c6eb7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.283159 May 16 18:52:27.685849 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 277/544] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:27 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:28.409088 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e29b7bc3-86d1-48e3-b967-fe598d68070f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:28.409692 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e29b7bc3-86d1-48e3-b967-fe598d68070f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:28.417585 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e29b7bc3-86d1-48e3-b967-fe598d68070f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:28.418039 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e29b7bc3-86d1-48e3-b967-fe598d68070f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:28.419852 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e29b7bc3-86d1-48e3-b967-fe598d68070f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:28.421723 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e29b7bc3-86d1-48e3-b967-fe598d68070f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:28.652590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e29b7bc3-86d1-48e3-b967-fe598d68070f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:28.668483 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e29b7bc3-86d1-48e3-b967-fe598d68070f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:28.671492 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e29b7bc3-86d1-48e3-b967-fe598d68070f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:28.673683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e29b7bc3-86d1-48e3-b967-fe598d68070f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.272349 May 16 18:52:28.674775 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 268/545] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:28 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:28.704262 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-53f3765e-9972-4e96-931c-075013299a4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:28.705316 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-53f3765e-9972-4e96-931c-075013299a4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:28.716768 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53f3765e-9972-4e96-931c-075013299a4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:28.717774 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53f3765e-9972-4e96-931c-075013299a4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:28.719519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53f3765e-9972-4e96-931c-075013299a4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:28.720789 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-53f3765e-9972-4e96-931c-075013299a4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:28.936320 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-53f3765e-9972-4e96-931c-075013299a4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:28.943330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3f735608-0893-456e-924b-9e18f96f4e6a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'create', calling method: .version_select at 0x7f646860c820>, body: {"keypair": {"name": "tempest-keypair-705470101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArsNgRwyyvCvFZH/LmrIEC9MqCoNJ6to6JYdnI2rFpHAbDU+9lwf+QzMPfr6UuGlrBrt0CzfTgHBbrxBvChU/gD4JNcsJsvSzxs1jDwa87rHjBf3oQGFlYC1jX2gw0Ptw=="}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:28.950771 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-53f3765e-9972-4e96-931c-075013299a4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.253525 May 16 18:52:28.951807 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 278/546] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:28 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:28.965873 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-3f735608-0893-456e-924b-9e18f96f4e6a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Getting quotas for project 9fe0e3c0f5eb4d4199f084be233eb1d3. Resources: {'key_pairs'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:52:28.975876 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-3f735608-0893-456e-924b-9e18f96f4e6a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Getting quotas for user 89539508b327427ba1a449fe30569606 and project 9fe0e3c0f5eb4d4199f084be233eb1d3. Resources: {'key_pairs'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:52:29.011972 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3f735608-0893-456e-924b-9e18f96f4e6a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074626 May 16 18:52:29.012597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 269/547] 10.222.0.72 () {60 vars in 1158 bytes} [Mon May 16 18:52:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:52:29.696292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5901c2b4-197c-4e50-b58d-a0579a6eada1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:29.697330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5901c2b4-197c-4e50-b58d-a0579a6eada1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:29.706349 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5901c2b4-197c-4e50-b58d-a0579a6eada1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:29.707335 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5901c2b4-197c-4e50-b58d-a0579a6eada1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:29.707683 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5901c2b4-197c-4e50-b58d-a0579a6eada1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:29.708163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5901c2b4-197c-4e50-b58d-a0579a6eada1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:29.918122 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5901c2b4-197c-4e50-b58d-a0579a6eada1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:29.946204 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5901c2b4-197c-4e50-b58d-a0579a6eada1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:29.949603 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5901c2b4-197c-4e50-b58d-a0579a6eada1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:29.952636 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5901c2b4-197c-4e50-b58d-a0579a6eada1 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.263367 May 16 18:52:29.968551 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 279/548] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:29 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:29.975449 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e5eae673-d015-463b-a844-d31af19c8025 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:29.979067 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e5eae673-d015-463b-a844-d31af19c8025 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:29.991554 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e5eae673-d015-463b-a844-d31af19c8025 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:29.993051 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e5eae673-d015-463b-a844-d31af19c8025 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:29.994945 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e5eae673-d015-463b-a844-d31af19c8025 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:29.996310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e5eae673-d015-463b-a844-d31af19c8025 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:30.245316 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e5eae673-d015-463b-a844-d31af19c8025 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:30.261694 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e5eae673-d015-463b-a844-d31af19c8025 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.296796 May 16 18:52:30.275745 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 270/549] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:29 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:30.916844 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1011304950", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4df4ca2b-7e61-442b-9928-5c7e92cf8bf8"}], "security_groups": [{"name": "tempest-securitygroup--111576192"}], "key_name": "tempest-keypair-705470101", "user_data": "}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:30.980600 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2dd11d6c-ddbd-4fe1-90a2-07d0ed0f6d3b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:30.981355 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2dd11d6c-ddbd-4fe1-90a2-07d0ed0f6d3b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:30.991035 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2dd11d6c-ddbd-4fe1-90a2-07d0ed0f6d3b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:30.991490 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2dd11d6c-ddbd-4fe1-90a2-07d0ed0f6d3b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:30.992389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2dd11d6c-ddbd-4fe1-90a2-07d0ed0f6d3b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:30.992995 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2dd11d6c-ddbd-4fe1-90a2-07d0ed0f6d3b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:31.122923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.network.neutron [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] validate_networks() for [('4df4ca2b-7e61-442b-9928-5c7e92cf8bf8', None, None, None, None, None)] {{(pid=128886) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:52:31.249810 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2dd11d6c-ddbd-4fe1-90a2-07d0ed0f6d3b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:31.265609 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2dd11d6c-ddbd-4fe1-90a2-07d0ed0f6d3b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:31.268892 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2dd11d6c-ddbd-4fe1-90a2-07d0ed0f6d3b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:31.271096 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2dd11d6c-ddbd-4fe1-90a2-07d0ed0f6d3b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.294332 May 16 18:52:31.272269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 271/550] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:30 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:31.292817 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-57b1c46b-fea6-4b05-8646-a07dc97060bd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:31.295031 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-57b1c46b-fea6-4b05-8646-a07dc97060bd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:31.314763 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-57b1c46b-fea6-4b05-8646-a07dc97060bd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:31.315505 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-57b1c46b-fea6-4b05-8646-a07dc97060bd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:31.316804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-57b1c46b-fea6-4b05-8646-a07dc97060bd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:31.317561 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-57b1c46b-fea6-4b05-8646-a07dc97060bd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:31.669858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-57b1c46b-fea6-4b05-8646-a07dc97060bd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:31.679653 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-57b1c46b-fea6-4b05-8646-a07dc97060bd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.396178 May 16 18:52:31.680961 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 272/551] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:31 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:31.844103 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Flavor limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:52:31.844938 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Image limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:52:31.845958 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Flavor pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:52:31.846781 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Image pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:52:31.847606 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:52:31.864014 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:31.864760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:31.866071 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:31.866920 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:31.890567 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Getting quotas for project 9fe0e3c0f5eb4d4199f084be233eb1d3. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:52:31.895375 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Getting quotas for user 89539508b327427ba1a449fe30569606 and project 9fe0e3c0f5eb4d4199f084be233eb1d3. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:52:31.923389 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Going to run 1 instances... {{(pid=128886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:52:31.927464 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:52:32.006185 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-4daf5638-013b-4f22-9f6b-353e69e1678c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.095376 May 16 18:52:32.007132 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 280/552] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:52:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 18:52:32.018703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f1ba8b6c-bf0b-4507-803f-9fc48b46b9ca tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:32.019599 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f1ba8b6c-bf0b-4507-803f-9fc48b46b9ca tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:32.115498 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f1ba8b6c-bf0b-4507-803f-9fc48b46b9ca tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:32.130486 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f1ba8b6c-bf0b-4507-803f-9fc48b46b9ca tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1245 microversion: 2.1 time: 0.116349 May 16 18:52:32.131536 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 273/553] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:32 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1245 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:32.293675 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-75b735e8-be43-48a8-9458-2b22db858456 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:32.295198 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-75b735e8-be43-48a8-9458-2b22db858456 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:32.302589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75b735e8-be43-48a8-9458-2b22db858456 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:32.303517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75b735e8-be43-48a8-9458-2b22db858456 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:32.305102 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75b735e8-be43-48a8-9458-2b22db858456 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:32.305854 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75b735e8-be43-48a8-9458-2b22db858456 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:32.494831 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-75b735e8-be43-48a8-9458-2b22db858456 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:32.511158 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-75b735e8-be43-48a8-9458-2b22db858456 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:32.513288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-75b735e8-be43-48a8-9458-2b22db858456 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:32.515078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-75b735e8-be43-48a8-9458-2b22db858456 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.226492 May 16 18:52:32.517356 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 281/554] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:32 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:32.708734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-86ca9150-a3dc-45be-9544-21681d92f01f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:32.710122 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-86ca9150-a3dc-45be-9544-21681d92f01f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:32.723281 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86ca9150-a3dc-45be-9544-21681d92f01f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:32.724408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86ca9150-a3dc-45be-9544-21681d92f01f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:32.725732 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86ca9150-a3dc-45be-9544-21681d92f01f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:32.726475 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-86ca9150-a3dc-45be-9544-21681d92f01f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:32.950836 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-86ca9150-a3dc-45be-9544-21681d92f01f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:32.965838 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-86ca9150-a3dc-45be-9544-21681d92f01f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.264697 May 16 18:52:32.968112 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 274/555] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:32 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:33.158160 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5d123496-0ebf-4af7-a044-0e977f77e14d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:33.159540 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5d123496-0ebf-4af7-a044-0e977f77e14d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:33.168586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d123496-0ebf-4af7-a044-0e977f77e14d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:33.170087 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d123496-0ebf-4af7-a044-0e977f77e14d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:33.171551 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d123496-0ebf-4af7-a044-0e977f77e14d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:33.172546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d123496-0ebf-4af7-a044-0e977f77e14d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:33.292854 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5d123496-0ebf-4af7-a044-0e977f77e14d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:33.307789 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5d123496-0ebf-4af7-a044-0e977f77e14d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1297 microversion: 2.1 time: 0.156924 May 16 18:52:33.314417 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 282/556] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:33 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1297 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:33.548265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-78813e0e-66ed-4d00-b5a5-a9c788d534ac tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:33.551014 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-78813e0e-66ed-4d00-b5a5-a9c788d534ac tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:33.565668 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78813e0e-66ed-4d00-b5a5-a9c788d534ac tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:33.566510 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78813e0e-66ed-4d00-b5a5-a9c788d534ac tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:33.568195 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78813e0e-66ed-4d00-b5a5-a9c788d534ac tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:33.568907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78813e0e-66ed-4d00-b5a5-a9c788d534ac tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:33.886231 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-78813e0e-66ed-4d00-b5a5-a9c788d534ac tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:33.897837 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-78813e0e-66ed-4d00-b5a5-a9c788d534ac tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:33.899585 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-78813e0e-66ed-4d00-b5a5-a9c788d534ac tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:33.900963 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-78813e0e-66ed-4d00-b5a5-a9c788d534ac tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.360664 May 16 18:52:33.901674 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 275/557] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:33 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:33.984666 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0a88316e-f216-496a-9255-e87288eb7c35 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:33.985261 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0a88316e-f216-496a-9255-e87288eb7c35 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:33.993382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a88316e-f216-496a-9255-e87288eb7c35 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:33.994181 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a88316e-f216-496a-9255-e87288eb7c35 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:33.995594 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a88316e-f216-496a-9255-e87288eb7c35 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:33.996450 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0a88316e-f216-496a-9255-e87288eb7c35 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:34.252378 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0a88316e-f216-496a-9255-e87288eb7c35 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:34.266523 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0a88316e-f216-496a-9255-e87288eb7c35 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.285977 May 16 18:52:34.268024 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 283/558] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:33 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:34.337377 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2c7ec045-bcbe-4f01-8ebe-131a91836534 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:34.338229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2c7ec045-bcbe-4f01-8ebe-131a91836534 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:34.349489 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c7ec045-bcbe-4f01-8ebe-131a91836534 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:34.350396 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c7ec045-bcbe-4f01-8ebe-131a91836534 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:34.351936 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c7ec045-bcbe-4f01-8ebe-131a91836534 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:34.352832 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2c7ec045-bcbe-4f01-8ebe-131a91836534 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:34.461844 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2c7ec045-bcbe-4f01-8ebe-131a91836534 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:34.473490 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2c7ec045-bcbe-4f01-8ebe-131a91836534 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1303 microversion: 2.1 time: 0.141875 May 16 18:52:34.474731 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 276/559] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:34 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:34.758603 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-5a5a9c45-2a1c-4d96-bb40-9034b64a7fab req-b812e322-141b-430e-af8f-e0d39100825f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de1432f-5419-4150-84a0-0fe456962ce9", "name": "network-vif-plugged", "status": "completed", "tag": "eeb3fe2b-d9aa-4852-85f0-2e9f90328234"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:34.777758 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-5a5a9c45-2a1c-4d96-bb40-9034b64a7fab req-b812e322-141b-430e-af8f-e0d39100825f service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:34.779221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-5a5a9c45-2a1c-4d96-bb40-9034b64a7fab req-b812e322-141b-430e-af8f-e0d39100825f service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:34.798674 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-5a5a9c45-2a1c-4d96-bb40-9034b64a7fab req-b812e322-141b-430e-af8f-e0d39100825f service nova] Creating event network-vif-plugged:eeb3fe2b-d9aa-4852-85f0-2e9f90328234 for instance 4de1432f-5419-4150-84a0-0fe456962ce9 on hv-cinder-75078 May 16 18:52:34.836577 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-5a5a9c45-2a1c-4d96-bb40-9034b64a7fab req-b812e322-141b-430e-af8f-e0d39100825f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070434 May 16 18:52:34.837673 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 284/560] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:52:34.936318 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d6e3fefc-41ee-4a8a-bbc1-abffe6989701 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:34.937504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d6e3fefc-41ee-4a8a-bbc1-abffe6989701 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:34.946493 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d6e3fefc-41ee-4a8a-bbc1-abffe6989701 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:34.947110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d6e3fefc-41ee-4a8a-bbc1-abffe6989701 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:34.948319 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d6e3fefc-41ee-4a8a-bbc1-abffe6989701 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:34.948902 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d6e3fefc-41ee-4a8a-bbc1-abffe6989701 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:35.162108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d6e3fefc-41ee-4a8a-bbc1-abffe6989701 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:35.177834 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d6e3fefc-41ee-4a8a-bbc1-abffe6989701 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:35.179600 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d6e3fefc-41ee-4a8a-bbc1-abffe6989701 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:35.180840 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d6e3fefc-41ee-4a8a-bbc1-abffe6989701 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.253851 May 16 18:52:35.185144 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 277/561] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:34 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:35.286156 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d93ab8e5-3b97-4b6e-acb7-da8551764f6c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:35.287328 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d93ab8e5-3b97-4b6e-acb7-da8551764f6c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:35.295249 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d93ab8e5-3b97-4b6e-acb7-da8551764f6c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:35.296089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d93ab8e5-3b97-4b6e-acb7-da8551764f6c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:35.297224 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d93ab8e5-3b97-4b6e-acb7-da8551764f6c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:35.297830 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d93ab8e5-3b97-4b6e-acb7-da8551764f6c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:35.496633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-73ecfebf-bb3e-4c0d-8219-bd7bec3ab54b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:35.497605 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-73ecfebf-bb3e-4c0d-8219-bd7bec3ab54b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:35.519917 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-73ecfebf-bb3e-4c0d-8219-bd7bec3ab54b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:35.521155 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-73ecfebf-bb3e-4c0d-8219-bd7bec3ab54b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:35.522281 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-73ecfebf-bb3e-4c0d-8219-bd7bec3ab54b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:35.522936 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-73ecfebf-bb3e-4c0d-8219-bd7bec3ab54b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:35.623289 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d93ab8e5-3b97-4b6e-acb7-da8551764f6c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:35.641304 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d93ab8e5-3b97-4b6e-acb7-da8551764f6c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.359018 May 16 18:52:35.642538 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 285/562] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:35 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:35.921812 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-73ecfebf-bb3e-4c0d-8219-bd7bec3ab54b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:35.939234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-73ecfebf-bb3e-4c0d-8219-bd7bec3ab54b tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1370 microversion: 2.1 time: 0.446011 May 16 18:52:35.940806 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 278/563] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:35 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1370 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:36.208073 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-beb62eaf-dada-446e-94ac-086172817c33 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:36.208749 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-beb62eaf-dada-446e-94ac-086172817c33 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:36.216852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-beb62eaf-dada-446e-94ac-086172817c33 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:36.217669 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-beb62eaf-dada-446e-94ac-086172817c33 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:36.218934 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-beb62eaf-dada-446e-94ac-086172817c33 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:36.219179 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-beb62eaf-dada-446e-94ac-086172817c33 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:36.486927 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-beb62eaf-dada-446e-94ac-086172817c33 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:36.505690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-beb62eaf-dada-446e-94ac-086172817c33 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:36.509283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-beb62eaf-dada-446e-94ac-086172817c33 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:36.511652 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-beb62eaf-dada-446e-94ac-086172817c33 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.310941 May 16 18:52:36.513551 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 286/564] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:36 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:36.639504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-6b38e6f6-c4a8-4e49-bc6d-d15739c00262 req-1d7ad20d-b96e-48fc-be42-76a0dd9e4ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08296f7c-a2cd-4a66-9f47-ae72714a4e37", "tag": "beee622c-240e-41d7-b32d-a07b68814889"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:36.666265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-76f2f5db-7f4f-4f41-847a-a28746789cab tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:36.668103 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-6b38e6f6-c4a8-4e49-bc6d-d15739c00262 req-1d7ad20d-b96e-48fc-be42-76a0dd9e4ee2 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:36.670111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-76f2f5db-7f4f-4f41-847a-a28746789cab tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:36.671008 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-6b38e6f6-c4a8-4e49-bc6d-d15739c00262 req-1d7ad20d-b96e-48fc-be42-76a0dd9e4ee2 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:36.689747 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76f2f5db-7f4f-4f41-847a-a28746789cab tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:36.690214 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76f2f5db-7f4f-4f41-847a-a28746789cab tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:36.691406 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76f2f5db-7f4f-4f41-847a-a28746789cab tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:36.692298 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76f2f5db-7f4f-4f41-847a-a28746789cab tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:36.698348 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-6b38e6f6-c4a8-4e49-bc6d-d15739c00262 req-1d7ad20d-b96e-48fc-be42-76a0dd9e4ee2 service nova] Creating event network-changed:beee622c-240e-41d7-b32d-a07b68814889 for instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 on hv-cinder-75078 May 16 18:52:36.705068 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-6b38e6f6-c4a8-4e49-bc6d-d15739c00262 req-1d7ad20d-b96e-48fc-be42-76a0dd9e4ee2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076993 May 16 18:52:36.705679 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 279/565] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:52:36.866495 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-b8e7ec55-ee75-4d5a-bdee-76da7f87f822 req-c714d9e7-c6de-4288-b7f3-4f05dafa2926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f61265-a9db-48ea-a142-5238bf17239d", "name": "network-vif-plugged", "status": "completed", "tag": "3ba065e3-302f-4b58-b666-92ac520ffc00"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:36.881136 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-b8e7ec55-ee75-4d5a-bdee-76da7f87f822 req-c714d9e7-c6de-4288-b7f3-4f05dafa2926 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:36.882275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-b8e7ec55-ee75-4d5a-bdee-76da7f87f822 req-c714d9e7-c6de-4288-b7f3-4f05dafa2926 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:36.889725 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-76f2f5db-7f4f-4f41-847a-a28746789cab tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:36.898081 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-76f2f5db-7f4f-4f41-847a-a28746789cab tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.239706 May 16 18:52:36.898414 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-b8e7ec55-ee75-4d5a-bdee-76da7f87f822 req-c714d9e7-c6de-4288-b7f3-4f05dafa2926 service nova] Creating event network-vif-plugged:3ba065e3-302f-4b58-b666-92ac520ffc00 for instance f9f61265-a9db-48ea-a142-5238bf17239d on hv-cinder-75078 May 16 18:52:36.898718 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 287/566] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:36 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:36.913332 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-b8e7ec55-ee75-4d5a-bdee-76da7f87f822 req-c714d9e7-c6de-4288-b7f3-4f05dafa2926 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055248 May 16 18:52:36.914550 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 280/567] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:52:36.964760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-75b123e0-8af8-4bbe-b03e-fe883087fea1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:36.965511 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-75b123e0-8af8-4bbe-b03e-fe883087fea1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:36.975509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75b123e0-8af8-4bbe-b03e-fe883087fea1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:36.976011 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75b123e0-8af8-4bbe-b03e-fe883087fea1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:36.977299 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75b123e0-8af8-4bbe-b03e-fe883087fea1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:36.977801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75b123e0-8af8-4bbe-b03e-fe883087fea1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:37.140167 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-75b123e0-8af8-4bbe-b03e-fe883087fea1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:37.149477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-75b123e0-8af8-4bbe-b03e-fe883087fea1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1370 microversion: 2.1 time: 0.190181 May 16 18:52:37.150154 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 288/568] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:36 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:37.541542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-55ab04e6-a3b5-44bc-aca8-e3e20efa63fc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:37.542361 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-55ab04e6-a3b5-44bc-aca8-e3e20efa63fc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:37.552954 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-55ab04e6-a3b5-44bc-aca8-e3e20efa63fc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:37.553413 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-55ab04e6-a3b5-44bc-aca8-e3e20efa63fc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:37.554247 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-55ab04e6-a3b5-44bc-aca8-e3e20efa63fc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:37.554695 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-55ab04e6-a3b5-44bc-aca8-e3e20efa63fc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:37.770802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-55ab04e6-a3b5-44bc-aca8-e3e20efa63fc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:37.786398 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-55ab04e6-a3b5-44bc-aca8-e3e20efa63fc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:37.789182 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-55ab04e6-a3b5-44bc-aca8-e3e20efa63fc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:37.791422 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-55ab04e6-a3b5-44bc-aca8-e3e20efa63fc tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.258008 May 16 18:52:37.792454 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 281/569] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:37 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:37.935478 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6093b614-abe5-4fd0-a49d-45bdd175a8ef tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:37.936221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6093b614-abe5-4fd0-a49d-45bdd175a8ef tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:37.944071 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6093b614-abe5-4fd0-a49d-45bdd175a8ef tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:37.944531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6093b614-abe5-4fd0-a49d-45bdd175a8ef tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:37.945322 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6093b614-abe5-4fd0-a49d-45bdd175a8ef tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:37.945793 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6093b614-abe5-4fd0-a49d-45bdd175a8ef tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:38.175752 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5d5a0069-1962-4391-80be-3ed151fe8e58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:38.177029 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5d5a0069-1962-4391-80be-3ed151fe8e58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:38.185692 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5d5a0069-1962-4391-80be-3ed151fe8e58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:38.185692 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5d5a0069-1962-4391-80be-3ed151fe8e58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:38.187135 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5d5a0069-1962-4391-80be-3ed151fe8e58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:38.187652 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5d5a0069-1962-4391-80be-3ed151fe8e58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:38.551248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6093b614-abe5-4fd0-a49d-45bdd175a8ef tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:38.560436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6093b614-abe5-4fd0-a49d-45bdd175a8ef tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.638471 May 16 18:52:38.573546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 289/570] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:37 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:38.573841 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5d5a0069-1962-4391-80be-3ed151fe8e58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:38.582982 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5d5a0069-1962-4391-80be-3ed151fe8e58 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1370 microversion: 2.1 time: 0.412531 May 16 18:52:38.583578 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 282/571] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:38 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1370 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:38.817517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2e96ef6a-f683-48bb-9862-751332272ad8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:38.817811 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2e96ef6a-f683-48bb-9862-751332272ad8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:38.825642 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e96ef6a-f683-48bb-9862-751332272ad8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:38.826367 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e96ef6a-f683-48bb-9862-751332272ad8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:38.827692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e96ef6a-f683-48bb-9862-751332272ad8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:38.828330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2e96ef6a-f683-48bb-9862-751332272ad8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:38.995779 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2e96ef6a-f683-48bb-9862-751332272ad8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:39.011929 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2e96ef6a-f683-48bb-9862-751332272ad8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:39.016600 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2e96ef6a-f683-48bb-9862-751332272ad8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:39.019690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2e96ef6a-f683-48bb-9862-751332272ad8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1808 microversion: 2.20 time: 0.206889 May 16 18:52:39.020975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 290/572] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:38 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:52:39.578269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-baf7d278-b05c-4e3b-be9a-0a5dea708904 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:39.578903 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-baf7d278-b05c-4e3b-be9a-0a5dea708904 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:39.585864 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-baf7d278-b05c-4e3b-be9a-0a5dea708904 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:39.586319 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-baf7d278-b05c-4e3b-be9a-0a5dea708904 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:39.587104 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-baf7d278-b05c-4e3b-be9a-0a5dea708904 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:39.587540 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-baf7d278-b05c-4e3b-be9a-0a5dea708904 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:39.605267 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-64b6730c-6fe3-4943-a100-231d81046d68 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:39.607294 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-64b6730c-6fe3-4943-a100-231d81046d68 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:39.617780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64b6730c-6fe3-4943-a100-231d81046d68 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:39.618560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64b6730c-6fe3-4943-a100-231d81046d68 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:39.619893 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64b6730c-6fe3-4943-a100-231d81046d68 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:39.620670 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-64b6730c-6fe3-4943-a100-231d81046d68 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:39.847636 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-baf7d278-b05c-4e3b-be9a-0a5dea708904 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:39.858157 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-baf7d278-b05c-4e3b-be9a-0a5dea708904 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1266 microversion: 2.1 time: 0.283924 May 16 18:52:39.859253 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 283/573] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:39 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:39.861261 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-64b6730c-6fe3-4943-a100-231d81046d68 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:39.871274 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-64b6730c-6fe3-4943-a100-231d81046d68 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1370 microversion: 2.1 time: 0.272650 May 16 18:52:39.872227 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 291/574] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:39 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1370 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:40.052230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-aff2908f-bb76-491f-9f85-1500c9dce0eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:40.052831 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-aff2908f-bb76-491f-9f85-1500c9dce0eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:40.060495 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aff2908f-bb76-491f-9f85-1500c9dce0eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:40.061313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aff2908f-bb76-491f-9f85-1500c9dce0eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:40.062727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aff2908f-bb76-491f-9f85-1500c9dce0eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:40.063569 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aff2908f-bb76-491f-9f85-1500c9dce0eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:40.251907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-aff2908f-bb76-491f-9f85-1500c9dce0eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:40.269691 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-aff2908f-bb76-491f-9f85-1500c9dce0eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:40.272009 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-aff2908f-bb76-491f-9f85-1500c9dce0eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:40.273792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-aff2908f-bb76-491f-9f85-1500c9dce0eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1795 microversion: 2.20 time: 0.225698 May 16 18:52:40.274593 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 284/575] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:52:40 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1795 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:52:40.881762 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-828bf172-8929-4cc8-bbdf-5eb2928fad68 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:40.882646 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-828bf172-8929-4cc8-bbdf-5eb2928fad68 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:40.893810 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-828bf172-8929-4cc8-bbdf-5eb2928fad68 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:40.894614 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-828bf172-8929-4cc8-bbdf-5eb2928fad68 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:40.895250 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-80f6b82e-3bfd-4fc5-8fc3-64a62dacfd56 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:40.895933 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-828bf172-8929-4cc8-bbdf-5eb2928fad68 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:40.896556 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-80f6b82e-3bfd-4fc5-8fc3-64a62dacfd56 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:40.896708 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-828bf172-8929-4cc8-bbdf-5eb2928fad68 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:40.908074 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-80f6b82e-3bfd-4fc5-8fc3-64a62dacfd56 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:40.908872 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-80f6b82e-3bfd-4fc5-8fc3-64a62dacfd56 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:40.910240 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-80f6b82e-3bfd-4fc5-8fc3-64a62dacfd56 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:40.911017 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-80f6b82e-3bfd-4fc5-8fc3-64a62dacfd56 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:41.239705 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-80f6b82e-3bfd-4fc5-8fc3-64a62dacfd56 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:41.247851 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-80f6b82e-3bfd-4fc5-8fc3-64a62dacfd56 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1370 microversion: 2.1 time: 0.361008 May 16 18:52:41.247851 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 285/576] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:40 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:52:41.250363 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-828bf172-8929-4cc8-bbdf-5eb2928fad68 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:41.259668 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-828bf172-8929-4cc8-bbdf-5eb2928fad68 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1452 microversion: 2.1 time: 0.382163 May 16 18:52:41.260377 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 292/577] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:40 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1452 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:41.287557 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7557d8c2-902f-4607-9b1c-cfd7c29e7192 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:41.288623 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7557d8c2-902f-4607-9b1c-cfd7c29e7192 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:41.295699 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7557d8c2-902f-4607-9b1c-cfd7c29e7192 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:41.296190 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7557d8c2-902f-4607-9b1c-cfd7c29e7192 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:41.296973 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7557d8c2-902f-4607-9b1c-cfd7c29e7192 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:41.297408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7557d8c2-902f-4607-9b1c-cfd7c29e7192 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:41.479832 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7557d8c2-902f-4607-9b1c-cfd7c29e7192 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:41.490075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7557d8c2-902f-4607-9b1c-cfd7c29e7192 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1452 microversion: 2.1 time: 0.208616 May 16 18:52:41.490558 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 286/578] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:41 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:42.270404 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c69b47b8-6d19-4f19-ab39-6215a91babea tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:42.271441 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c69b47b8-6d19-4f19-ab39-6215a91babea tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:42.278537 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c69b47b8-6d19-4f19-ab39-6215a91babea tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:42.279091 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c69b47b8-6d19-4f19-ab39-6215a91babea tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:42.279966 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c69b47b8-6d19-4f19-ab39-6215a91babea tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:42.280435 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c69b47b8-6d19-4f19-ab39-6215a91babea tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:42.565585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c69b47b8-6d19-4f19-ab39-6215a91babea tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:42.577665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c69b47b8-6d19-4f19-ab39-6215a91babea tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1370 microversion: 2.1 time: 0.311675 May 16 18:52:42.578536 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 293/579] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:42 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:43.609595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e1f10270-0947-4ca4-9533-2b86029c5365 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:43.610681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e1f10270-0947-4ca4-9533-2b86029c5365 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:43.621901 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e1f10270-0947-4ca4-9533-2b86029c5365 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:43.622720 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e1f10270-0947-4ca4-9533-2b86029c5365 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:43.624127 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e1f10270-0947-4ca4-9533-2b86029c5365 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:43.624915 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e1f10270-0947-4ca4-9533-2b86029c5365 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:43.861152 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e1f10270-0947-4ca4-9533-2b86029c5365 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:43.874513 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e1f10270-0947-4ca4-9533-2b86029c5365 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1370 microversion: 2.1 time: 0.272586 May 16 18:52:43.875441 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 287/580] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:43 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:44.021266 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-bd7a1825-17a6-4cee-ae08-5946eb364708 req-720a19a9-dd10-49ed-971a-c7d497fe93fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9f61265-a9db-48ea-a142-5238bf17239d", "tag": "3ba065e3-302f-4b58-b666-92ac520ffc00"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:44.032340 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-bd7a1825-17a6-4cee-ae08-5946eb364708 req-720a19a9-dd10-49ed-971a-c7d497fe93fd service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:44.032923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-bd7a1825-17a6-4cee-ae08-5946eb364708 req-720a19a9-dd10-49ed-971a-c7d497fe93fd service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:44.049325 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-bd7a1825-17a6-4cee-ae08-5946eb364708 req-720a19a9-dd10-49ed-971a-c7d497fe93fd service nova] Creating event network-changed:3ba065e3-302f-4b58-b666-92ac520ffc00 for instance f9f61265-a9db-48ea-a142-5238bf17239d on hv-cinder-75078 May 16 18:52:44.055153 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-bd7a1825-17a6-4cee-ae08-5946eb364708 req-720a19a9-dd10-49ed-971a-c7d497fe93fd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037532 May 16 18:52:44.056296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 294/581] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:52:44.902154 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-57876c48-880c-4721-a1ea-9e61e601ee5c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:44.904744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-57876c48-880c-4721-a1ea-9e61e601ee5c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:44.916329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-57876c48-880c-4721-a1ea-9e61e601ee5c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:44.917128 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-57876c48-880c-4721-a1ea-9e61e601ee5c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:44.918580 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-57876c48-880c-4721-a1ea-9e61e601ee5c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:44.919882 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-57876c48-880c-4721-a1ea-9e61e601ee5c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:45.137149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-57876c48-880c-4721-a1ea-9e61e601ee5c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:45.152626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-57876c48-880c-4721-a1ea-9e61e601ee5c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1370 microversion: 2.1 time: 0.256928 May 16 18:52:45.154949 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 288/582] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:44 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:45.988851 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-adf6fba7-8ec7-4a4a-acd4-a4556955e397 req-4e3d8c46-d758-413a-acc0-e5125c921286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08296f7c-a2cd-4a66-9f47-ae72714a4e37", "name": "network-vif-plugged", "status": "completed", "tag": "beee622c-240e-41d7-b32d-a07b68814889"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:45.997965 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-adf6fba7-8ec7-4a4a-acd4-a4556955e397 req-4e3d8c46-d758-413a-acc0-e5125c921286 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:45.998669 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-adf6fba7-8ec7-4a4a-acd4-a4556955e397 req-4e3d8c46-d758-413a-acc0-e5125c921286 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:46.012437 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-adf6fba7-8ec7-4a4a-acd4-a4556955e397 req-4e3d8c46-d758-413a-acc0-e5125c921286 service nova] Creating event network-vif-plugged:beee622c-240e-41d7-b32d-a07b68814889 for instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 on hv-cinder-75078 May 16 18:52:46.017859 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-adf6fba7-8ec7-4a4a-acd4-a4556955e397 req-4e3d8c46-d758-413a-acc0-e5125c921286 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033777 May 16 18:52:46.018570 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 295/583] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:52:46.179210 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b20d74d2-6ed6-401c-aa5c-aae7cd3292b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:46.180050 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b20d74d2-6ed6-401c-aa5c-aae7cd3292b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:46.188281 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b20d74d2-6ed6-401c-aa5c-aae7cd3292b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:46.189121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b20d74d2-6ed6-401c-aa5c-aae7cd3292b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:46.190709 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b20d74d2-6ed6-401c-aa5c-aae7cd3292b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:46.191462 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b20d74d2-6ed6-401c-aa5c-aae7cd3292b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:46.380187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b20d74d2-6ed6-401c-aa5c-aae7cd3292b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:46.394469 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b20d74d2-6ed6-401c-aa5c-aae7cd3292b6 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1370 microversion: 2.1 time: 0.219277 May 16 18:52:46.395529 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 289/584] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:46 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:47.422463 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-958ed8cd-4592-4320-a079-2995564c7d47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:47.423278 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-958ed8cd-4592-4320-a079-2995564c7d47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:47.429983 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-958ed8cd-4592-4320-a079-2995564c7d47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:47.430435 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-958ed8cd-4592-4320-a079-2995564c7d47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:47.431226 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-958ed8cd-4592-4320-a079-2995564c7d47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:47.431664 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-958ed8cd-4592-4320-a079-2995564c7d47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:47.615737 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-958ed8cd-4592-4320-a079-2995564c7d47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:47.627016 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-958ed8cd-4592-4320-a079-2995564c7d47 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1370 microversion: 2.1 time: 0.209803 May 16 18:52:47.628050 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 296/585] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:47 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:48.654034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f2bca5c5-7922-4416-a224-296a725ce62a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:48.655093 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f2bca5c5-7922-4416-a224-296a725ce62a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:48.664463 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f2bca5c5-7922-4416-a224-296a725ce62a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:48.665245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f2bca5c5-7922-4416-a224-296a725ce62a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:48.666594 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f2bca5c5-7922-4416-a224-296a725ce62a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:48.667376 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f2bca5c5-7922-4416-a224-296a725ce62a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:48.853915 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f2bca5c5-7922-4416-a224-296a725ce62a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:48.865731 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f2bca5c5-7922-4416-a224-296a725ce62a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1564 microversion: 2.1 time: 0.219091 May 16 18:52:48.866330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 290/586] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:48 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1564 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:48.893559 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-20133b97-8db9-4c87-998c-aa73e2ed4d37 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:48.894369 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-20133b97-8db9-4c87-998c-aa73e2ed4d37 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:48.902705 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-20133b97-8db9-4c87-998c-aa73e2ed4d37 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:48.903230 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-20133b97-8db9-4c87-998c-aa73e2ed4d37 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:48.904225 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-20133b97-8db9-4c87-998c-aa73e2ed4d37 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:48.904612 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-20133b97-8db9-4c87-998c-aa73e2ed4d37 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:49.029335 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-20133b97-8db9-4c87-998c-aa73e2ed4d37 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141659 May 16 18:52:49.030345 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 297/587] 10.222.0.72 () {58 vars in 1274 bytes} [Mon May 16 18:52:48 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:52:50.596925 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-bcc2d84b-0392-4847-bea7-fe6c3c519c00 req-99e3bf00-b370-419b-8069-30ce72dc7399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08296f7c-a2cd-4a66-9f47-ae72714a4e37", "tag": "beee622c-240e-41d7-b32d-a07b68814889"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:50.620232 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-bcc2d84b-0392-4847-bea7-fe6c3c519c00 req-99e3bf00-b370-419b-8069-30ce72dc7399 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:50.621016 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-bcc2d84b-0392-4847-bea7-fe6c3c519c00 req-99e3bf00-b370-419b-8069-30ce72dc7399 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:50.635667 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-bcc2d84b-0392-4847-bea7-fe6c3c519c00 req-99e3bf00-b370-419b-8069-30ce72dc7399 service nova] Creating event network-changed:beee622c-240e-41d7-b32d-a07b68814889 for instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 on hv-cinder-75078 May 16 18:52:50.643320 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-bcc2d84b-0392-4847-bea7-fe6c3c519c00 req-99e3bf00-b370-419b-8069-30ce72dc7399 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053285 May 16 18:52:50.644645 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 291/588] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:52:55.066442 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-50c120ef-5bc7-421d-8b44-1fe2f51651a7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:55.067110 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-50c120ef-5bc7-421d-8b44-1fe2f51651a7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:55.077487 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50c120ef-5bc7-421d-8b44-1fe2f51651a7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:55.078138 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50c120ef-5bc7-421d-8b44-1fe2f51651a7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:55.079506 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50c120ef-5bc7-421d-8b44-1fe2f51651a7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:55.080337 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50c120ef-5bc7-421d-8b44-1fe2f51651a7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:55.227304 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-50c120ef-5bc7-421d-8b44-1fe2f51651a7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lazy-loading 'services' on Instance uuid bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:52:55.392679 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-50c120ef-5bc7-421d-8b44-1fe2f51651a7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/os-volume_attachments/d5258563-86d2-46c5-b8ca-297c45483e60" status: 202 len: 0 microversion: 2.1 time: 0.330800 May 16 18:52:55.393794 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 298/589] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 18:52:55 2022] DELETE /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/os-volume_attachments/d5258563-86d2-46c5-b8ca-297c45483e60 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 18:52:57.611534 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-02a06b40-1616-4d2f-b17c-729dffbcf925 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:52:57.618162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-02a06b40-1616-4d2f-b17c-729dffbcf925 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:57.618684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-02a06b40-1616-4d2f-b17c-729dffbcf925 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:57.642792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-02a06b40-1616-4d2f-b17c-729dffbcf925 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Going to try to stop instance {{(pid=128887) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 18:52:57.693015 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-02a06b40-1616-4d2f-b17c-729dffbcf925 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/action" status: 202 len: 0 microversion: 2.1 time: 0.086753 May 16 18:52:57.693822 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 292/590] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:52:57 2022] POST /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:52:57.710304 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9ccaa4b1-9d0d-4f95-bd72-d5b319409467 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:57.711603 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9ccaa4b1-9d0d-4f95-bd72-d5b319409467 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:57.720402 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ccaa4b1-9d0d-4f95-bd72-d5b319409467 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:57.720857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ccaa4b1-9d0d-4f95-bd72-d5b319409467 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:57.721741 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ccaa4b1-9d0d-4f95-bd72-d5b319409467 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:57.722200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ccaa4b1-9d0d-4f95-bd72-d5b319409467 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:57.893652 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9ccaa4b1-9d0d-4f95-bd72-d5b319409467 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:57.906557 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9ccaa4b1-9d0d-4f95-bd72-d5b319409467 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.205229 May 16 18:52:57.907151 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 299/591] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:57 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:52:58.928290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-fb20ce9d-aa58-4cdd-8d32-72bca389da78 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:52:58.928290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-fb20ce9d-aa58-4cdd-8d32-72bca389da78 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:52:58.936129 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fb20ce9d-aa58-4cdd-8d32-72bca389da78 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:58.936586 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fb20ce9d-aa58-4cdd-8d32-72bca389da78 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:58.937374 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fb20ce9d-aa58-4cdd-8d32-72bca389da78 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:52:58.937807 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fb20ce9d-aa58-4cdd-8d32-72bca389da78 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:52:59.133903 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fb20ce9d-aa58-4cdd-8d32-72bca389da78 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:52:59.146294 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-fb20ce9d-aa58-4cdd-8d32-72bca389da78 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.222966 May 16 18:52:59.147242 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 293/592] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:52:58 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:53:00.169548 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7b38ace9-3f00-4a1c-b235-7399ea7e0a4b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:00.170158 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7b38ace9-3f00-4a1c-b235-7399ea7e0a4b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:00.179145 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7b38ace9-3f00-4a1c-b235-7399ea7e0a4b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:00.179804 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7b38ace9-3f00-4a1c-b235-7399ea7e0a4b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:00.181077 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7b38ace9-3f00-4a1c-b235-7399ea7e0a4b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:00.181841 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7b38ace9-3f00-4a1c-b235-7399ea7e0a4b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:00.364221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7b38ace9-3f00-4a1c-b235-7399ea7e0a4b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:00.387866 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7b38ace9-3f00-4a1c-b235-7399ea7e0a4b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.222512 May 16 18:53:00.388890 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 300/593] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:00 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:53:00.414521 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-daa97e2c-5604-41ef-a2db-5521354c9742 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:00.415405 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-daa97e2c-5604-41ef-a2db-5521354c9742 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:00.424034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daa97e2c-5604-41ef-a2db-5521354c9742 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:00.424487 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daa97e2c-5604-41ef-a2db-5521354c9742 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:00.425286 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daa97e2c-5604-41ef-a2db-5521354c9742 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:00.425727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-daa97e2c-5604-41ef-a2db-5521354c9742 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:00.456175 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-daa97e2c-5604-41ef-a2db-5521354c9742 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9/ips" status: 200 len: 150 microversion: 2.1 time: 0.049567 May 16 18:53:00.456842 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 294/594] 10.222.0.72 () {58 vars in 1247 bytes} [Mon May 16 18:53:00 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9/ips => generated 150 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:00.476468 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-76ea2bc9-1186-43aa-9ca7-8d83bc5dc68b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "599ec1c1-d7d6-45f6-a1ec-e8a174763d12"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:00.477613 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-76ea2bc9-1186-43aa-9ca7-8d83bc5dc68b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:00.484703 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76ea2bc9-1186-43aa-9ca7-8d83bc5dc68b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:00.485200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76ea2bc9-1186-43aa-9ca7-8d83bc5dc68b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:00.486378 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76ea2bc9-1186-43aa-9ca7-8d83bc5dc68b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:00.486902 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76ea2bc9-1186-43aa-9ca7-8d83bc5dc68b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:00.585522 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-76ea2bc9-1186-43aa-9ca7-8d83bc5dc68b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Invalid volume: volume 599ec1c1-d7d6-45f6-a1ec-e8a174763d12 is already attached to instances: ec82e115-5ca8-47de-ba42-405096ec5d98 May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-76ea2bc9-1186-43aa-9ca7-8d83bc5dc68b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: POST /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9/os-volume_attachments HTTP/1.1 May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 74 May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:53:00.589069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {"volumeAttachment": {"volumeId": "599ec1c1-d7d6-45f6-a1ec-e8a174763d12"}} May 16 18:53:00.592681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Invalid volume: volume 599ec1c1-d7d6-45f6-a1ec-e8a174763d12 is already attached to instances: ec82e115-5ca8-47de-ba42-405096ec5d98 May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'server_id': '2b6715a3-0274-463c-b6e5-4116112ef2c9', 'body': {'volumeAttachment': {'volumeId': '599ec1c1-d7d6-45f6-a1ec-e8a174763d12'}}} May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 599ec1c1-d7d6-45f6-a1ec-e8a174763d12 is already attached to instances: ec82e115-5ca8-47de-ba42-405096ec5d98 May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:00.594884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 599ec1c1-d7d6-45f6-a1ec-e8a174763d12 is already attached to instances: ec82e115-5ca8-47de-ba42-405096ec5d98 May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:00.598109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:53:00.600648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:53:00.600648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:53:00.600648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:53:00.600648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 599ec1c1-d7d6-45f6-a1ec-e8a174763d12 is already attached to instances: ec82e115-5ca8-47de-ba42-405096ec5d98 May 16 18:53:00.600648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:00.600648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-76ea2bc9-1186-43aa-9ca7-8d83bc5dc68b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 400 to user: Invalid volume: volume 599ec1c1-d7d6-45f6-a1ec-e8a174763d12 is already attached to instances: ec82e115-5ca8-47de-ba42-405096ec5d98 {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:53:00.600648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-76ea2bc9-1186-43aa-9ca7-8d83bc5dc68b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121409 May 16 18:53:00.600648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 301/595] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:53:00 2022] POST /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 18:53:00.611924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8e1873ff-f18d-466e-a921-5a9c099c9c6e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:00.612834 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8e1873ff-f18d-466e-a921-5a9c099c9c6e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:00.623967 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e1873ff-f18d-466e-a921-5a9c099c9c6e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:00.624739 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e1873ff-f18d-466e-a921-5a9c099c9c6e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:00.625974 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e1873ff-f18d-466e-a921-5a9c099c9c6e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:00.626494 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e1873ff-f18d-466e-a921-5a9c099c9c6e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:00.657856 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8e1873ff-f18d-466e-a921-5a9c099c9c6e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:53:00.749208 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8e1873ff-f18d-466e-a921-5a9c099c9c6e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 204 len: 0 microversion: 2.1 time: 0.144665 May 16 18:53:00.750164 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 295/596] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:53:00 2022] DELETE /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:53:00.762144 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d7c6ab29-25cc-464d-8a1f-39bd6c151450 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:00.763327 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d7c6ab29-25cc-464d-8a1f-39bd6c151450 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:00.774989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d7c6ab29-25cc-464d-8a1f-39bd6c151450 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:00.775753 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d7c6ab29-25cc-464d-8a1f-39bd6c151450 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:00.777090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d7c6ab29-25cc-464d-8a1f-39bd6c151450 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:00.778483 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d7c6ab29-25cc-464d-8a1f-39bd6c151450 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:00.972815 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d7c6ab29-25cc-464d-8a1f-39bd6c151450 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:00.984594 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d7c6ab29-25cc-464d-8a1f-39bd6c151450 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1681 microversion: 2.1 time: 0.228299 May 16 18:53:00.985190 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 302/597] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:00 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:53:01.427156 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6d143a60-bf19-4aa8-b5ce-485ea3db7349 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:01.428462 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6d143a60-bf19-4aa8-b5ce-485ea3db7349 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:01.439669 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d143a60-bf19-4aa8-b5ce-485ea3db7349 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:01.440504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d143a60-bf19-4aa8-b5ce-485ea3db7349 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:01.441894 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d143a60-bf19-4aa8-b5ce-485ea3db7349 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:01.442676 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6d143a60-bf19-4aa8-b5ce-485ea3db7349 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:01.632408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6d143a60-bf19-4aa8-b5ce-485ea3db7349 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:01.646044 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6d143a60-bf19-4aa8-b5ce-485ea3db7349 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.226594 May 16 18:53:01.646993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 296/598] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:01 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:02.003122 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-524f73e2-ab59-4c48-ac5b-7bae08bb91b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:02.003879 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-524f73e2-ab59-4c48-ac5b-7bae08bb91b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:02.015111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-524f73e2-ab59-4c48-ac5b-7bae08bb91b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:02.015935 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-524f73e2-ab59-4c48-ac5b-7bae08bb91b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:02.017382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-524f73e2-ab59-4c48-ac5b-7bae08bb91b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:02.018114 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-524f73e2-ab59-4c48-ac5b-7bae08bb91b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:02.195835 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-524f73e2-ab59-4c48-ac5b-7bae08bb91b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:02.204284 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-524f73e2-ab59-4c48-ac5b-7bae08bb91b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1681 microversion: 2.1 time: 0.204955 May 16 18:53:02.204870 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 303/599] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:01 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:02.669580 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a297d97a-4cbf-4a57-9ce7-53cfe2cf762b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:02.670695 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a297d97a-4cbf-4a57-9ce7-53cfe2cf762b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:02.683151 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a297d97a-4cbf-4a57-9ce7-53cfe2cf762b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:02.684446 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a297d97a-4cbf-4a57-9ce7-53cfe2cf762b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:02.685528 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a297d97a-4cbf-4a57-9ce7-53cfe2cf762b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:02.686336 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a297d97a-4cbf-4a57-9ce7-53cfe2cf762b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:02.850830 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a297d97a-4cbf-4a57-9ce7-53cfe2cf762b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:02.859912 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a297d97a-4cbf-4a57-9ce7-53cfe2cf762b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.197368 May 16 18:53:02.860664 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 297/600] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:02 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:03.222794 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-868d7582-66d3-4dac-adfd-33f6cbf0597d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:03.223607 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-868d7582-66d3-4dac-adfd-33f6cbf0597d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:03.231583 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-868d7582-66d3-4dac-adfd-33f6cbf0597d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:03.232059 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-868d7582-66d3-4dac-adfd-33f6cbf0597d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:03.232832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-868d7582-66d3-4dac-adfd-33f6cbf0597d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:03.233262 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-868d7582-66d3-4dac-adfd-33f6cbf0597d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:03.408545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-868d7582-66d3-4dac-adfd-33f6cbf0597d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:03.418271 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-868d7582-66d3-4dac-adfd-33f6cbf0597d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1681 microversion: 2.1 time: 0.199418 May 16 18:53:03.419183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 304/601] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:03 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:03.892471 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-70771f7e-b8af-4045-8426-b6eba2452200 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:03.893337 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-70771f7e-b8af-4045-8426-b6eba2452200 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:03.904705 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-70771f7e-b8af-4045-8426-b6eba2452200 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:03.905677 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-70771f7e-b8af-4045-8426-b6eba2452200 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:03.907268 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-70771f7e-b8af-4045-8426-b6eba2452200 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:03.908051 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-70771f7e-b8af-4045-8426-b6eba2452200 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:04.147635 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-7498556f-8fc8-4763-b28e-9ff85e4d5969 req-24ba9eb8-290b-43a4-a301-38b65b821098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6715a3-0274-463c-b6e5-4116112ef2c9", "name": "network-vif-deleted", "tag": "e2de6415-3434-48d3-a9f3-46de3d297b6e"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:04.150357 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-70771f7e-b8af-4045-8426-b6eba2452200 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:04.163008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-7498556f-8fc8-4763-b28e-9ff85e4d5969 req-24ba9eb8-290b-43a4-a301-38b65b821098 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:04.164812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-7498556f-8fc8-4763-b28e-9ff85e4d5969 req-24ba9eb8-290b-43a4-a301-38b65b821098 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:04.172627 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-70771f7e-b8af-4045-8426-b6eba2452200 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.287196 May 16 18:53:04.173675 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 298/602] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:03 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:04.209834 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-7498556f-8fc8-4763-b28e-9ff85e4d5969 req-24ba9eb8-290b-43a4-a301-38b65b821098 service nova] Creating event network-vif-deleted:e2de6415-3434-48d3-a9f3-46de3d297b6e for instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 on hv-cinder-75078 May 16 18:53:04.220766 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-7498556f-8fc8-4763-b28e-9ff85e4d5969 req-24ba9eb8-290b-43a4-a301-38b65b821098 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076664 May 16 18:53:04.223700 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 305/603] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:53:04.441216 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:04.442521 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:04.461670 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:04.462543 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:04.463834 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:04.464417 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:04.531407 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:04.532280 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:04.533133 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lazy-loading 'fault' on Instance uuid 2b6715a3-0274-463c-b6e5-4116112ef2c9 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:53:04.614496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:04.625568 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6f2c0351-1f15-409e-abe9-0b76f41ebcfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 200 len: 1330 microversion: 2.1 time: 0.190204 May 16 18:53:04.626229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 299/604] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:04 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 1330 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:05.202290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ed4f7ca6-fa3c-45a4-a636-2e518513eb5e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:05.203300 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ed4f7ca6-fa3c-45a4-a636-2e518513eb5e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:05.213094 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ed4f7ca6-fa3c-45a4-a636-2e518513eb5e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:05.213812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ed4f7ca6-fa3c-45a4-a636-2e518513eb5e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:05.215767 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ed4f7ca6-fa3c-45a4-a636-2e518513eb5e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:05.216711 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ed4f7ca6-fa3c-45a4-a636-2e518513eb5e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:05.399106 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ed4f7ca6-fa3c-45a4-a636-2e518513eb5e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:05.419958 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ed4f7ca6-fa3c-45a4-a636-2e518513eb5e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.223451 May 16 18:53:05.421005 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 306/605] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:05 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:05.650953 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6ebe2af0-1ec7-4b1c-b832-28a77cabd04b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:05.652121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6ebe2af0-1ec7-4b1c-b832-28a77cabd04b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:05.663769 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ebe2af0-1ec7-4b1c-b832-28a77cabd04b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:05.664420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ebe2af0-1ec7-4b1c-b832-28a77cabd04b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:05.665846 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ebe2af0-1ec7-4b1c-b832-28a77cabd04b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:05.666446 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ebe2af0-1ec7-4b1c-b832-28a77cabd04b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:05.685633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-6ebe2af0-1ec7-4b1c-b832-28a77cabd04b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6ebe2af0-1ec7-4b1c-b832-28a77cabd04b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 HTTP/1.1 May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:53:05.688321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:53:05.691106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '2b6715a3-0274-463c-b6e5-4116112ef2c9'} May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:53:05.692773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:53:05.695437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:53:05.698671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6ebe2af0-1ec7-4b1c-b832-28a77cabd04b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:53:05.698671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6ebe2af0-1ec7-4b1c-b832-28a77cabd04b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 404 len: 111 microversion: 2.1 time: 0.047027 May 16 18:53:05.703940 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 300/606] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:05 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:53:05.706856 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c2370bdc-8a0e-4ff2-8733-af9da6e3fe5b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '.version_select at 0x7f646d0169d0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:05.748451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c2370bdc-8a0e-4ff2-8733-af9da6e3fe5b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-431365184" status: 202 len: 0 microversion: 2.1 time: 0.049554 May 16 18:53:05.749479 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 307/607] 10.222.0.72 () {58 vars in 1217 bytes} [Mon May 16 18:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-431365184 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:53:06.441196 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-055bcb0a-821e-43ab-a320-53d9d52ac639 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:06.441818 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-055bcb0a-821e-43ab-a320-53d9d52ac639 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:06.448616 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-055bcb0a-821e-43ab-a320-53d9d52ac639 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:06.450222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-055bcb0a-821e-43ab-a320-53d9d52ac639 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:06.451672 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-055bcb0a-821e-43ab-a320-53d9d52ac639 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:06.452609 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-055bcb0a-821e-43ab-a320-53d9d52ac639 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:06.804322 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-055bcb0a-821e-43ab-a320-53d9d52ac639 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:06.815852 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-055bcb0a-821e-43ab-a320-53d9d52ac639 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.378375 May 16 18:53:06.816626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 301/608] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:06 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:06.909578 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9ea0945a-8a28-41d1-8fe3-c738f4f07924 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:06.910342 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9ea0945a-8a28-41d1-8fe3-c738f4f07924 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:06.919852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ea0945a-8a28-41d1-8fe3-c738f4f07924 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:06.920522 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ea0945a-8a28-41d1-8fe3-c738f4f07924 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:06.921681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ea0945a-8a28-41d1-8fe3-c738f4f07924 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:06.922361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9ea0945a-8a28-41d1-8fe3-c738f4f07924 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:07.049131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-9ea0945a-8a28-41d1-8fe3-c738f4f07924 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lazy-loading 'services' on Instance uuid ec82e115-5ca8-47de-ba42-405096ec5d98 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:53:07.134014 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9ea0945a-8a28-41d1-8fe3-c738f4f07924 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-volume_attachments/599ec1c1-d7d6-45f6-a1ec-e8a174763d12" status: 202 len: 0 microversion: 2.1 time: 0.231989 May 16 18:53:07.134770 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 308/609] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 18:53:06 2022] DELETE /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-volume_attachments/599ec1c1-d7d6-45f6-a1ec-e8a174763d12 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:53:07.148701 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-95c5ba25-bd41-4a1e-a585-7799fa78fa64 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:07.150248 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-95c5ba25-bd41-4a1e-a585-7799fa78fa64 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:07.160064 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95c5ba25-bd41-4a1e-a585-7799fa78fa64 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:07.160346 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95c5ba25-bd41-4a1e-a585-7799fa78fa64 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:07.161639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95c5ba25-bd41-4a1e-a585-7799fa78fa64 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:07.162450 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95c5ba25-bd41-4a1e-a585-7799fa78fa64 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:07.216242 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-95c5ba25-bd41-4a1e-a585-7799fa78fa64 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075403 May 16 18:53:07.216933 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 302/610] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:53:07 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:53:07.852305 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-182de576-1e83-4592-b25b-bbbfc7d7070b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:07.853343 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-182de576-1e83-4592-b25b-bbbfc7d7070b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:07.869828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-182de576-1e83-4592-b25b-bbbfc7d7070b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:07.870288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-182de576-1e83-4592-b25b-bbbfc7d7070b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:07.871960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-182de576-1e83-4592-b25b-bbbfc7d7070b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:07.872518 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-182de576-1e83-4592-b25b-bbbfc7d7070b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:08.046610 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-182de576-1e83-4592-b25b-bbbfc7d7070b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:08.060911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-182de576-1e83-4592-b25b-bbbfc7d7070b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.215238 May 16 18:53:08.061687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 309/611] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:07 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:08.234958 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5dd0fc2c-e273-45e3-a4cf-ab9f92c3f45f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:08.236497 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5dd0fc2c-e273-45e3-a4cf-ab9f92c3f45f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:08.244555 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5dd0fc2c-e273-45e3-a4cf-ab9f92c3f45f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:08.245008 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5dd0fc2c-e273-45e3-a4cf-ab9f92c3f45f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:08.246686 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5dd0fc2c-e273-45e3-a4cf-ab9f92c3f45f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:08.247125 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5dd0fc2c-e273-45e3-a4cf-ab9f92c3f45f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:08.279456 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5dd0fc2c-e273-45e3-a4cf-ab9f92c3f45f tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052695 May 16 18:53:08.280079 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 303/612] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:53:08 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:09.083196 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a9a245ae-e883-4b84-9c5d-7cf3e1deb7e0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:09.084079 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a9a245ae-e883-4b84-9c5d-7cf3e1deb7e0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:09.090352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a9a245ae-e883-4b84-9c5d-7cf3e1deb7e0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:09.090799 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a9a245ae-e883-4b84-9c5d-7cf3e1deb7e0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:09.091564 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a9a245ae-e883-4b84-9c5d-7cf3e1deb7e0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:09.092031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a9a245ae-e883-4b84-9c5d-7cf3e1deb7e0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:09.229930 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a9a245ae-e883-4b84-9c5d-7cf3e1deb7e0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:09.240226 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a9a245ae-e883-4b84-9c5d-7cf3e1deb7e0 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.160594 May 16 18:53:09.241178 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 310/613] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:09 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:53:09.291401 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-19f3e0f7-341a-4182-90bc-03bf906477a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:09.292373 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-19f3e0f7-341a-4182-90bc-03bf906477a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:09.299476 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-19f3e0f7-341a-4182-90bc-03bf906477a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:09.299952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-19f3e0f7-341a-4182-90bc-03bf906477a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:09.300718 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-19f3e0f7-341a-4182-90bc-03bf906477a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:09.301148 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-19f3e0f7-341a-4182-90bc-03bf906477a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:09.334383 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-19f3e0f7-341a-4182-90bc-03bf906477a4 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046776 May 16 18:53:09.334957 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 304/614] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:53:09 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 18:53:09.409373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c856cdb9-4a99-4b13-8cae-fefb3015ea96 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:09.409906 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c856cdb9-4a99-4b13-8cae-fefb3015ea96 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:09.416097 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c856cdb9-4a99-4b13-8cae-fefb3015ea96 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:09.416558 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c856cdb9-4a99-4b13-8cae-fefb3015ea96 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:09.417349 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c856cdb9-4a99-4b13-8cae-fefb3015ea96 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:09.418348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c856cdb9-4a99-4b13-8cae-fefb3015ea96 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:09.451250 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c856cdb9-4a99-4b13-8cae-fefb3015ea96 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Going to try to terminate instance {{(pid=128886) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:53:09.557576 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c856cdb9-4a99-4b13-8cae-fefb3015ea96 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 204 len: 0 microversion: 2.1 time: 0.154417 May 16 18:53:09.559260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 311/615] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:53:09 2022] DELETE /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:53:09.571442 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b3d986eb-afed-48e6-8b11-13e50bd98153 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:09.572526 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b3d986eb-afed-48e6-8b11-13e50bd98153 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:09.582301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b3d986eb-afed-48e6-8b11-13e50bd98153 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:09.582874 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b3d986eb-afed-48e6-8b11-13e50bd98153 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:09.583827 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b3d986eb-afed-48e6-8b11-13e50bd98153 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:09.584597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b3d986eb-afed-48e6-8b11-13e50bd98153 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:09.766089 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b3d986eb-afed-48e6-8b11-13e50bd98153 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:09.774284 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b3d986eb-afed-48e6-8b11-13e50bd98153 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1680 microversion: 2.1 time: 0.209334 May 16 18:53:09.774866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 305/616] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:09 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:53:10.265184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f9b0c40f-92ed-4d82-a0ca-4c7ad6ff8c60 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:10.266350 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f9b0c40f-92ed-4d82-a0ca-4c7ad6ff8c60 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:10.274928 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f9b0c40f-92ed-4d82-a0ca-4c7ad6ff8c60 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:10.275468 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f9b0c40f-92ed-4d82-a0ca-4c7ad6ff8c60 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:10.276723 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f9b0c40f-92ed-4d82-a0ca-4c7ad6ff8c60 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:10.277711 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f9b0c40f-92ed-4d82-a0ca-4c7ad6ff8c60 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:10.461022 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f9b0c40f-92ed-4d82-a0ca-4c7ad6ff8c60 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:10.474291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f9b0c40f-92ed-4d82-a0ca-4c7ad6ff8c60 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.215387 May 16 18:53:10.475368 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 312/617] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:10 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:10.793895 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-66de889a-6797-4276-8d12-f9bb5746efeb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:10.794627 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-66de889a-6797-4276-8d12-f9bb5746efeb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:10.802659 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-66de889a-6797-4276-8d12-f9bb5746efeb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:10.803103 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-66de889a-6797-4276-8d12-f9bb5746efeb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:10.803926 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-66de889a-6797-4276-8d12-f9bb5746efeb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:10.804389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-66de889a-6797-4276-8d12-f9bb5746efeb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:10.964795 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-66de889a-6797-4276-8d12-f9bb5746efeb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:10.977420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-66de889a-6797-4276-8d12-f9bb5746efeb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1680 microversion: 2.1 time: 0.187568 May 16 18:53:10.978480 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 306/618] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:10 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:11.501306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-69892619-3344-479b-8fa1-8d010549cfb5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:11.502648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-69892619-3344-479b-8fa1-8d010549cfb5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:11.512503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69892619-3344-479b-8fa1-8d010549cfb5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:11.513029 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69892619-3344-479b-8fa1-8d010549cfb5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:11.513846 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69892619-3344-479b-8fa1-8d010549cfb5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:11.514842 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69892619-3344-479b-8fa1-8d010549cfb5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:11.700975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-69892619-3344-479b-8fa1-8d010549cfb5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:11.711184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-69892619-3344-479b-8fa1-8d010549cfb5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.219352 May 16 18:53:11.712196 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 313/619] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:11 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:12.001947 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5b7eabc5-2fb9-4d05-9408-07203b27e3cb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:12.002649 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5b7eabc5-2fb9-4d05-9408-07203b27e3cb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:12.014017 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5b7eabc5-2fb9-4d05-9408-07203b27e3cb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:12.014740 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5b7eabc5-2fb9-4d05-9408-07203b27e3cb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:12.016827 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5b7eabc5-2fb9-4d05-9408-07203b27e3cb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:12.017462 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5b7eabc5-2fb9-4d05-9408-07203b27e3cb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:12.175072 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5b7eabc5-2fb9-4d05-9408-07203b27e3cb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:12.186273 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5b7eabc5-2fb9-4d05-9408-07203b27e3cb tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1680 microversion: 2.1 time: 0.188470 May 16 18:53:12.187187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 307/620] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:11 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:12.738792 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9589674b-ee91-4500-8b9d-daa1f6a4aa07 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:12.739506 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9589674b-ee91-4500-8b9d-daa1f6a4aa07 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:12.749222 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9589674b-ee91-4500-8b9d-daa1f6a4aa07 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:12.749962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9589674b-ee91-4500-8b9d-daa1f6a4aa07 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:12.751184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9589674b-ee91-4500-8b9d-daa1f6a4aa07 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:12.751806 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9589674b-ee91-4500-8b9d-daa1f6a4aa07 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:12.954508 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9589674b-ee91-4500-8b9d-daa1f6a4aa07 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:12.968916 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9589674b-ee91-4500-8b9d-daa1f6a4aa07 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1675 microversion: 2.1 time: 0.235240 May 16 18:53:12.978065 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 314/621] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:12 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1675 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:13.048994 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-c6129c25-93cc-45f3-8085-f74b383d2a21 req-299ea2cf-e1a6-4d47-8a66-1bb62aad238c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec82e115-5ca8-47de-ba42-405096ec5d98", "name": "network-vif-deleted", "tag": "f4c32d27-4431-4863-bb69-09faf2b82b93"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:13.060142 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-c6129c25-93cc-45f3-8085-f74b383d2a21 req-299ea2cf-e1a6-4d47-8a66-1bb62aad238c service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:13.060804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-c6129c25-93cc-45f3-8085-f74b383d2a21 req-299ea2cf-e1a6-4d47-8a66-1bb62aad238c service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:13.081433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-c6129c25-93cc-45f3-8085-f74b383d2a21 req-299ea2cf-e1a6-4d47-8a66-1bb62aad238c service nova] Creating event network-vif-deleted:f4c32d27-4431-4863-bb69-09faf2b82b93 for instance ec82e115-5ca8-47de-ba42-405096ec5d98 on hv-cinder-75078 May 16 18:53:13.090507 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-c6129c25-93cc-45f3-8085-f74b383d2a21 req-299ea2cf-e1a6-4d47-8a66-1bb62aad238c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046258 May 16 18:53:13.091793 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 308/622] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:13.210572 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-34f4c454-3ecd-4d77-9dde-be7dc70aee8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:13.211505 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-34f4c454-3ecd-4d77-9dde-be7dc70aee8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:13.219633 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-34f4c454-3ecd-4d77-9dde-be7dc70aee8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:13.220451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-34f4c454-3ecd-4d77-9dde-be7dc70aee8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:13.221447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-34f4c454-3ecd-4d77-9dde-be7dc70aee8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:13.222035 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-34f4c454-3ecd-4d77-9dde-be7dc70aee8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:13.305270 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-34f4c454-3ecd-4d77-9dde-be7dc70aee8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:13.320066 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-34f4c454-3ecd-4d77-9dde-be7dc70aee8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 200 len: 1325 microversion: 2.1 time: 0.112955 May 16 18:53:13.321379 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 315/623] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:13 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 1325 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:13.989007 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-859ff397-3bef-4366-ab13-135341533db5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:13.989800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-859ff397-3bef-4366-ab13-135341533db5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:13.996773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-859ff397-3bef-4366-ab13-135341533db5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:13.997369 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-859ff397-3bef-4366-ab13-135341533db5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:13.998192 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-859ff397-3bef-4366-ab13-135341533db5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:13.998800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-859ff397-3bef-4366-ab13-135341533db5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:14.171208 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-859ff397-3bef-4366-ab13-135341533db5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:14.183850 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-859ff397-3bef-4366-ab13-135341533db5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1652 microversion: 2.1 time: 0.199258 May 16 18:53:14.185477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 309/624] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:13 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1652 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:14.209646 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-02d3dc2a-2ab1-4ae0-b9f6-c78376e5fc64 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:14.218355 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-02d3dc2a-2ab1-4ae0-b9f6-c78376e5fc64 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:14.218901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-02d3dc2a-2ab1-4ae0-b9f6-c78376e5fc64 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:14.252367 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-02d3dc2a-2ab1-4ae0-b9f6-c78376e5fc64 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Going to try to start instance {{(pid=128886) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 18:53:14.321085 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-02d3dc2a-2ab1-4ae0-b9f6-c78376e5fc64 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/action" status: 202 len: 0 microversion: 2.1 time: 0.115100 May 16 18:53:14.321957 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 316/625] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:53:14 2022] POST /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:53:14.332505 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-42529f54-640b-49d4-a895-cdf64e22d8bf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:14.333291 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-42529f54-640b-49d4-a895-cdf64e22d8bf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:14.346949 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f2539625-51ae-44f4-811a-ca04a2053be2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:14.348130 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f2539625-51ae-44f4-811a-ca04a2053be2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:14.354960 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-42529f54-640b-49d4-a895-cdf64e22d8bf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:14.355373 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-42529f54-640b-49d4-a895-cdf64e22d8bf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:14.356069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f2539625-51ae-44f4-811a-ca04a2053be2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:14.356834 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f2539625-51ae-44f4-811a-ca04a2053be2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:14.357896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f2539625-51ae-44f4-811a-ca04a2053be2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:14.358512 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f2539625-51ae-44f4-811a-ca04a2053be2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:14.360059 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-42529f54-640b-49d4-a895-cdf64e22d8bf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:14.362797 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-42529f54-640b-49d4-a895-cdf64e22d8bf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:14.383899 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-f2539625-51ae-44f4-811a-ca04a2053be2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f2539625-51ae-44f4-811a-ca04a2053be2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 HTTP/1.1 May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:53:14.385773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:53:14.388897 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'ec82e115-5ca8-47de-ba42-405096ec5d98'} May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:53:14.390465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:53:14.392319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:14.393655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f2539625-51ae-44f4-811a-ca04a2053be2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:53:14.393655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f2539625-51ae-44f4-811a-ca04a2053be2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 404 len: 111 microversion: 2.1 time: 0.046470 May 16 18:53:14.393655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 317/626] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:14 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:53:14.398365 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7945f74f-aadf-4ded-adf3-659b71165ffc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '.version_select at 0x7f646d026dc0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:14.420583 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7945f74f-aadf-4ded-adf3-659b71165ffc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-880387144" status: 202 len: 0 microversion: 2.1 time: 0.025937 May 16 18:53:14.421279 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 318/627] 10.222.0.72 () {58 vars in 1217 bytes} [Mon May 16 18:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-880387144 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:53:14.576359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-42529f54-640b-49d4-a895-cdf64e22d8bf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:14.590267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-42529f54-640b-49d4-a895-cdf64e22d8bf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1661 microversion: 2.1 time: 0.261822 May 16 18:53:14.590994 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 310/628] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:14 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1661 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:15.311131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-88376c46-f970-4c6f-b535-dfc61bb5320b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: .version_select at 0x7f645bfc8ee0>, body: {"keypair": {"name": "tempest-keypair-368513386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdMX7EJttMlRq6HK9VxZjWg/aIUqhjO+VW3WP4eLzsallGaAgzwE4Mod6qKJad/7DWfkfEhYPKwFbzii5utpF6D2e+Noz7P16+SkfSVAcRycjmsKNvvUQgWLLeUGw1gag=="}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:15.336818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-88376c46-f970-4c6f-b535-dfc61bb5320b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:53:15.342289 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-88376c46-f970-4c6f-b535-dfc61bb5320b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for user cd0d8acbe24d410690470e3d9d4882b1 and project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:53:15.374723 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-88376c46-f970-4c6f-b535-dfc61bb5320b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071837 May 16 18:53:15.375335 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 319/629] 10.222.0.72 () {60 vars in 1158 bytes} [Mon May 16 18:53:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:15.613027 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-bc738714-d9cf-4598-82c4-cdfce5f0bf3f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:15.613957 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-bc738714-d9cf-4598-82c4-cdfce5f0bf3f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:15.621909 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bc738714-d9cf-4598-82c4-cdfce5f0bf3f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:15.622481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bc738714-d9cf-4598-82c4-cdfce5f0bf3f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:15.623406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bc738714-d9cf-4598-82c4-cdfce5f0bf3f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:15.624237 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bc738714-d9cf-4598-82c4-cdfce5f0bf3f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:15.850125 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bc738714-d9cf-4598-82c4-cdfce5f0bf3f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:15.867204 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-bc738714-d9cf-4598-82c4-cdfce5f0bf3f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1661 microversion: 2.1 time: 0.259002 May 16 18:53:15.868227 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 311/630] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:15 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1661 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:16.890378 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-daaec006-6c10-4bdb-9e6f-8211ffd33b63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:16.891070 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-daaec006-6c10-4bdb-9e6f-8211ffd33b63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:16.902289 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-daaec006-6c10-4bdb-9e6f-8211ffd33b63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:16.903332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-daaec006-6c10-4bdb-9e6f-8211ffd33b63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:16.905632 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-daaec006-6c10-4bdb-9e6f-8211ffd33b63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:16.906546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-daaec006-6c10-4bdb-9e6f-8211ffd33b63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:17.112722 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-daaec006-6c10-4bdb-9e6f-8211ffd33b63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:17.114436 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1377005660", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "236a317a-f889-44df-b53d-ac5f81a24b24"}], "security_groups": [{"name": "tempest-securitygroup--1109516052"}], "key_name": "tempest-keypair-368513386", "user_data": "}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:17.124245 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-daaec006-6c10-4bdb-9e6f-8211ffd33b63 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1665 microversion: 2.1 time: 0.240472 May 16 18:53:17.124843 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 320/631] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:16 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1665 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:17.242526 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] validate_networks() for [('236a317a-f889-44df-b53d-ac5f81a24b24', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:53:17.715657 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:53:17.716082 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:53:17.716548 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:53:17.716948 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:53:17.717350 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:53:17.728682 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:17.729468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:17.731583 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:17.732406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:17.763995 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:53:17.771389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for user cd0d8acbe24d410690470e3d9d4882b1 and project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:53:17.791241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:53:17.797420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:53:17.863812 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f2de2af6-8cc8-44c2-9958-cfe4e4d36e29 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.754855 May 16 18:53:17.865293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 312/632] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:53:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:53:17.880464 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2ba99fc3-20eb-498e-bccf-b9a8d0ebf697 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:17.881500 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2ba99fc3-20eb-498e-bccf-b9a8d0ebf697 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:17.959195 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2ba99fc3-20eb-498e-bccf-b9a8d0ebf697 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:17.968677 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2ba99fc3-20eb-498e-bccf-b9a8d0ebf697 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1241 microversion: 2.1 time: 0.093626 May 16 18:53:17.969277 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 321/633] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:17 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:18.989828 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-117636d6-c9f9-4a18-87c2-1af17857c8d2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:18.990495 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-117636d6-c9f9-4a18-87c2-1af17857c8d2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:19.000774 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-117636d6-c9f9-4a18-87c2-1af17857c8d2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:19.001220 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-117636d6-c9f9-4a18-87c2-1af17857c8d2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:19.002221 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-117636d6-c9f9-4a18-87c2-1af17857c8d2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:19.002661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-117636d6-c9f9-4a18-87c2-1af17857c8d2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:19.098428 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-117636d6-c9f9-4a18-87c2-1af17857c8d2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:19.113976 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-117636d6-c9f9-4a18-87c2-1af17857c8d2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1293 microversion: 2.1 time: 0.128709 May 16 18:53:19.114683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 313/634] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:18 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1293 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:20.140702 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f79002de-35e8-4ca2-b397-f7212d39a6ff tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:20.141877 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f79002de-35e8-4ca2-b397-f7212d39a6ff tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:20.155792 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f79002de-35e8-4ca2-b397-f7212d39a6ff tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:20.156623 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f79002de-35e8-4ca2-b397-f7212d39a6ff tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:20.158039 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f79002de-35e8-4ca2-b397-f7212d39a6ff tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:20.158859 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f79002de-35e8-4ca2-b397-f7212d39a6ff tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:20.362333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f79002de-35e8-4ca2-b397-f7212d39a6ff tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:20.371877 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f79002de-35e8-4ca2-b397-f7212d39a6ff tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1367 microversion: 2.1 time: 0.239692 May 16 18:53:20.373174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 322/635] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:20 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:20.926113 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-c85ec1c3-3b79-4445-9dda-4d9ade961d12 req-9d7756cb-8105-4979-ab0f-c60e0dd59e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce01de2-ca20-437e-93cb-975e3add0542", "tag": "7c0dd6ff-ef1c-4ed0-809d-6f90671e139b"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:20.944006 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-c85ec1c3-3b79-4445-9dda-4d9ade961d12 req-9d7756cb-8105-4979-ab0f-c60e0dd59e4b service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:20.945060 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-c85ec1c3-3b79-4445-9dda-4d9ade961d12 req-9d7756cb-8105-4979-ab0f-c60e0dd59e4b service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:20.969363 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-c85ec1c3-3b79-4445-9dda-4d9ade961d12 req-9d7756cb-8105-4979-ab0f-c60e0dd59e4b service nova] Creating event network-changed:7c0dd6ff-ef1c-4ed0-809d-6f90671e139b for instance bce01de2-ca20-437e-93cb-975e3add0542 on hv-cinder-75078 May 16 18:53:20.981376 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-c85ec1c3-3b79-4445-9dda-4d9ade961d12 req-9d7756cb-8105-4979-ab0f-c60e0dd59e4b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064846 May 16 18:53:20.982124 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 314/636] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:21.395737 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6d7eed7c-65b1-443c-a4b2-6384aec1eea1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:21.396565 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6d7eed7c-65b1-443c-a4b2-6384aec1eea1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:21.406054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6d7eed7c-65b1-443c-a4b2-6384aec1eea1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:21.406577 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6d7eed7c-65b1-443c-a4b2-6384aec1eea1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:21.407418 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6d7eed7c-65b1-443c-a4b2-6384aec1eea1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:21.407952 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6d7eed7c-65b1-443c-a4b2-6384aec1eea1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:21.591241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6d7eed7c-65b1-443c-a4b2-6384aec1eea1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:21.605303 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6d7eed7c-65b1-443c-a4b2-6384aec1eea1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1367 microversion: 2.1 time: 0.213697 May 16 18:53:21.606693 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 323/637] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:21 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:22.635392 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-94747b59-f685-4e01-936e-66d586d355b5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:22.637447 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-94747b59-f685-4e01-936e-66d586d355b5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:22.644260 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-94747b59-f685-4e01-936e-66d586d355b5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:22.644710 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-94747b59-f685-4e01-936e-66d586d355b5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:22.645478 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-94747b59-f685-4e01-936e-66d586d355b5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:22.645912 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-94747b59-f685-4e01-936e-66d586d355b5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:22.826411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-94747b59-f685-4e01-936e-66d586d355b5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:22.835058 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-94747b59-f685-4e01-936e-66d586d355b5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1367 microversion: 2.1 time: 0.206832 May 16 18:53:22.835652 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 315/638] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:22 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:23.854289 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f79fd721-cb10-407f-8c67-7d056da8e9f2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:23.854930 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f79fd721-cb10-407f-8c67-7d056da8e9f2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:23.862830 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f79fd721-cb10-407f-8c67-7d056da8e9f2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:23.863286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f79fd721-cb10-407f-8c67-7d056da8e9f2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:23.864547 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f79fd721-cb10-407f-8c67-7d056da8e9f2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:23.865285 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f79fd721-cb10-407f-8c67-7d056da8e9f2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:24.032798 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f79fd721-cb10-407f-8c67-7d056da8e9f2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:24.042923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f79fd721-cb10-407f-8c67-7d056da8e9f2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1367 microversion: 2.1 time: 0.192327 May 16 18:53:24.043920 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 324/639] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:23 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:25.060728 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2f8653fb-40a2-403f-8528-6371e1733b0c tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:25.061632 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2f8653fb-40a2-403f-8528-6371e1733b0c tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:25.068645 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2f8653fb-40a2-403f-8528-6371e1733b0c tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:25.069092 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2f8653fb-40a2-403f-8528-6371e1733b0c tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:25.069887 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2f8653fb-40a2-403f-8528-6371e1733b0c tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:25.070304 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2f8653fb-40a2-403f-8528-6371e1733b0c tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:25.255216 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2f8653fb-40a2-403f-8528-6371e1733b0c tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:25.264052 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2f8653fb-40a2-403f-8528-6371e1733b0c tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1367 microversion: 2.1 time: 0.207842 May 16 18:53:25.264688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 316/640] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:25 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:26.093170 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-31480518-e761-4a81-a8e1-5389d9439ce2 req-40215dd3-cb8f-4854-a60d-a7b05926468b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce01de2-ca20-437e-93cb-975e3add0542", "name": "network-vif-plugged", "status": "completed", "tag": "7c0dd6ff-ef1c-4ed0-809d-6f90671e139b"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:26.107516 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-31480518-e761-4a81-a8e1-5389d9439ce2 req-40215dd3-cb8f-4854-a60d-a7b05926468b service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:26.107995 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-31480518-e761-4a81-a8e1-5389d9439ce2 req-40215dd3-cb8f-4854-a60d-a7b05926468b service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:26.128796 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-31480518-e761-4a81-a8e1-5389d9439ce2 req-40215dd3-cb8f-4854-a60d-a7b05926468b service nova] Creating event network-vif-plugged:7c0dd6ff-ef1c-4ed0-809d-6f90671e139b for instance bce01de2-ca20-437e-93cb-975e3add0542 on hv-cinder-75078 May 16 18:53:26.138126 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-31480518-e761-4a81-a8e1-5389d9439ce2 req-40215dd3-cb8f-4854-a60d-a7b05926468b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052621 May 16 18:53:26.138886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 325/641] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:26.295490 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-51e519b6-f02c-40bc-ada6-05c6d28592c5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:26.296226 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-51e519b6-f02c-40bc-ada6-05c6d28592c5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:26.302474 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-51e519b6-f02c-40bc-ada6-05c6d28592c5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:26.302928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-51e519b6-f02c-40bc-ada6-05c6d28592c5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:26.303698 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-51e519b6-f02c-40bc-ada6-05c6d28592c5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:26.304168 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-51e519b6-f02c-40bc-ada6-05c6d28592c5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:26.491369 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-51e519b6-f02c-40bc-ada6-05c6d28592c5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:26.499937 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-51e519b6-f02c-40bc-ada6-05c6d28592c5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1367 microversion: 2.1 time: 0.214954 May 16 18:53:26.500566 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 317/642] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:26 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:27.518738 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6e285a8a-4956-4a1e-9fae-3698f33ce1d1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:27.519351 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6e285a8a-4956-4a1e-9fae-3698f33ce1d1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:27.527950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6e285a8a-4956-4a1e-9fae-3698f33ce1d1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:27.528382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6e285a8a-4956-4a1e-9fae-3698f33ce1d1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:27.529171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6e285a8a-4956-4a1e-9fae-3698f33ce1d1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:27.529609 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6e285a8a-4956-4a1e-9fae-3698f33ce1d1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:27.694321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6e285a8a-4956-4a1e-9fae-3698f33ce1d1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:27.707191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6e285a8a-4956-4a1e-9fae-3698f33ce1d1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1367 microversion: 2.1 time: 0.193079 May 16 18:53:27.708089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 326/643] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:27 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:28.732477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-baee33aa-b47e-408f-b4e1-66109c8de08a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:28.733333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-baee33aa-b47e-408f-b4e1-66109c8de08a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:28.739918 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-baee33aa-b47e-408f-b4e1-66109c8de08a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:28.740370 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-baee33aa-b47e-408f-b4e1-66109c8de08a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:28.741144 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-baee33aa-b47e-408f-b4e1-66109c8de08a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:28.741584 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-baee33aa-b47e-408f-b4e1-66109c8de08a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:28.904740 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-baee33aa-b47e-408f-b4e1-66109c8de08a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:28.912676 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-baee33aa-b47e-408f-b4e1-66109c8de08a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1557 microversion: 2.1 time: 0.184953 May 16 18:53:28.913279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 318/644] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:28 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1557 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:28.933833 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-69b0e8b4-9a84-4e49-a0aa-ad7b3ab502ea tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:28.934496 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-69b0e8b4-9a84-4e49-a0aa-ad7b3ab502ea tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:28.941255 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69b0e8b4-9a84-4e49-a0aa-ad7b3ab502ea tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:28.941704 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69b0e8b4-9a84-4e49-a0aa-ad7b3ab502ea tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:28.942471 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69b0e8b4-9a84-4e49-a0aa-ad7b3ab502ea tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:28.942902 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-69b0e8b4-9a84-4e49-a0aa-ad7b3ab502ea tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:29.057352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-69b0e8b4-9a84-4e49-a0aa-ad7b3ab502ea tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129498 May 16 18:53:29.059900 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 327/645] 10.222.0.72 () {58 vars in 1274 bytes} [Mon May 16 18:53:28 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:30.509698 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-a9f7e3ef-c503-463b-83c2-669f3420a6c2 req-dc9d4ea4-8b9c-4230-be55-5d12341f65dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce01de2-ca20-437e-93cb-975e3add0542", "tag": "7c0dd6ff-ef1c-4ed0-809d-6f90671e139b"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:30.524333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-a9f7e3ef-c503-463b-83c2-669f3420a6c2 req-dc9d4ea4-8b9c-4230-be55-5d12341f65dd service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:30.525279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-a9f7e3ef-c503-463b-83c2-669f3420a6c2 req-dc9d4ea4-8b9c-4230-be55-5d12341f65dd service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:30.547124 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-a9f7e3ef-c503-463b-83c2-669f3420a6c2 req-dc9d4ea4-8b9c-4230-be55-5d12341f65dd service nova] Creating event network-changed:7c0dd6ff-ef1c-4ed0-809d-6f90671e139b for instance bce01de2-ca20-437e-93cb-975e3add0542 on hv-cinder-75078 May 16 18:53:30.554815 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-a9f7e3ef-c503-463b-83c2-669f3420a6c2 req-dc9d4ea4-8b9c-4230-be55-5d12341f65dd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048935 May 16 18:53:30.555795 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 319/646] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:39.040236 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-74c86dc6-7fc2-4d7b-aad4-3d89f141ac4a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:39.040851 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-74c86dc6-7fc2-4d7b-aad4-3d89f141ac4a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:39.048420 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-74c86dc6-7fc2-4d7b-aad4-3d89f141ac4a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:39.048896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-74c86dc6-7fc2-4d7b-aad4-3d89f141ac4a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:39.049668 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-74c86dc6-7fc2-4d7b-aad4-3d89f141ac4a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:39.050098 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-74c86dc6-7fc2-4d7b-aad4-3d89f141ac4a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:39.083490 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-74c86dc6-7fc2-4d7b-aad4-3d89f141ac4a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-volume_attachments/13bfe0cd-115b-4d43-97ca-f8bb0f89bfe7" status: 200 len: 194 microversion: 2.20 time: 0.047778 May 16 18:53:39.084131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 328/647] 10.222.0.72 () {60 vars in 1453 bytes} [Mon May 16 18:53:39 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-volume_attachments/13bfe0cd-115b-4d43-97ca-f8bb0f89bfe7 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:53:39.155905 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8bbf3862-f8ee-452a-bc44-3bab9fabeeec tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:39.156733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8bbf3862-f8ee-452a-bc44-3bab9fabeeec tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:39.163685 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8bbf3862-f8ee-452a-bc44-3bab9fabeeec tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:39.164232 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8bbf3862-f8ee-452a-bc44-3bab9fabeeec tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:39.165118 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8bbf3862-f8ee-452a-bc44-3bab9fabeeec tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:39.165651 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8bbf3862-f8ee-452a-bc44-3bab9fabeeec tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:39.519684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-8bbf3862-f8ee-452a-bc44-3bab9fabeeec tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lazy-loading 'services' on Instance uuid 4de1432f-5419-4150-84a0-0fe456962ce9 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:53:39.655219 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8bbf3862-f8ee-452a-bc44-3bab9fabeeec tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-volume_attachments/13bfe0cd-115b-4d43-97ca-f8bb0f89bfe7" status: 202 len: 0 microversion: 2.20 time: 0.503911 May 16 18:53:39.656021 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 320/648] 10.222.0.72 () {60 vars in 1456 bytes} [Mon May 16 18:53:39 2022] DELETE /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-volume_attachments/13bfe0cd-115b-4d43-97ca-f8bb0f89bfe7 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 16 18:53:39.664938 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a8f00895-5129-4506-9ef6-d1ac5889add3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:39.665962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a8f00895-5129-4506-9ef6-d1ac5889add3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:39.672898 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a8f00895-5129-4506-9ef6-d1ac5889add3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:39.673353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a8f00895-5129-4506-9ef6-d1ac5889add3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:39.674127 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a8f00895-5129-4506-9ef6-d1ac5889add3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:39.674563 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a8f00895-5129-4506-9ef6-d1ac5889add3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:39.708865 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a8f00895-5129-4506-9ef6-d1ac5889add3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048069 May 16 18:53:39.709442 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 329/649] 10.222.0.72 () {60 vars in 1342 bytes} [Mon May 16 18:53:39 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:53:40.731213 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f7094268-0e54-4919-b886-d222bbe41815 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:40.733884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f7094268-0e54-4919-b886-d222bbe41815 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:40.742728 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f7094268-0e54-4919-b886-d222bbe41815 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:40.744225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f7094268-0e54-4919-b886-d222bbe41815 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:40.746557 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f7094268-0e54-4919-b886-d222bbe41815 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:40.747026 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f7094268-0e54-4919-b886-d222bbe41815 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:40.790082 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f7094268-0e54-4919-b886-d222bbe41815 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069339 May 16 18:53:40.790652 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 321/650] 10.222.0.72 () {60 vars in 1342 bytes} [Mon May 16 18:53:40 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:40.856519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-78fce2d1-2f14-4d25-bc0c-04e9bb5fd9d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:40.857388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-78fce2d1-2f14-4d25-bc0c-04e9bb5fd9d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:40.865453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-78fce2d1-2f14-4d25-bc0c-04e9bb5fd9d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:40.866034 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-78fce2d1-2f14-4d25-bc0c-04e9bb5fd9d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:40.866909 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-78fce2d1-2f14-4d25-bc0c-04e9bb5fd9d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:40.867606 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-78fce2d1-2f14-4d25-bc0c-04e9bb5fd9d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:40.904008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-78fce2d1-2f14-4d25-bc0c-04e9bb5fd9d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Going to try to terminate instance {{(pid=128886) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:53:40.996168 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-78fce2d1-2f14-4d25-bc0c-04e9bb5fd9d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 204 len: 0 microversion: 2.20 time: 0.144914 May 16 18:53:40.996947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 330/651] 10.222.0.72 () {60 vars in 1279 bytes} [Mon May 16 18:53:40 2022] DELETE /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 18:53:41.006282 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-78b92235-fd75-4701-a025-dcff5a1642fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:41.007050 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-78b92235-fd75-4701-a025-dcff5a1642fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:41.014946 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78b92235-fd75-4701-a025-dcff5a1642fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:41.015544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78b92235-fd75-4701-a025-dcff5a1642fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:41.016442 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78b92235-fd75-4701-a025-dcff5a1642fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:41.016966 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-78b92235-fd75-4701-a025-dcff5a1642fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:41.187224 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-78b92235-fd75-4701-a025-dcff5a1642fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:41.195620 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-78b92235-fd75-4701-a025-dcff5a1642fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:41.197205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-78b92235-fd75-4701-a025-dcff5a1642fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:41.198996 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-78b92235-fd75-4701-a025-dcff5a1642fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.197436 May 16 18:53:41.199638 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 322/652] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:41 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:42.220191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bf1e0466-a986-4028-97d8-1282e3487b48 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:42.220899 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-bf1e0466-a986-4028-97d8-1282e3487b48 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:42.227467 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf1e0466-a986-4028-97d8-1282e3487b48 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:42.227957 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf1e0466-a986-4028-97d8-1282e3487b48 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:42.228768 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf1e0466-a986-4028-97d8-1282e3487b48 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:42.229903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf1e0466-a986-4028-97d8-1282e3487b48 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:42.466525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bf1e0466-a986-4028-97d8-1282e3487b48 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:42.475584 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bf1e0466-a986-4028-97d8-1282e3487b48 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:42.477055 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bf1e0466-a986-4028-97d8-1282e3487b48 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:42.478238 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-bf1e0466-a986-4028-97d8-1282e3487b48 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.262713 May 16 18:53:42.478833 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 331/653] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:42 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:43.501953 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-332e24f3-8630-49f9-9162-729aeb9859d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:43.502930 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-332e24f3-8630-49f9-9162-729aeb9859d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:43.514772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-332e24f3-8630-49f9-9162-729aeb9859d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:43.515547 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-332e24f3-8630-49f9-9162-729aeb9859d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:43.516940 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-332e24f3-8630-49f9-9162-729aeb9859d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:43.517846 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-332e24f3-8630-49f9-9162-729aeb9859d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:43.715611 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-332e24f3-8630-49f9-9162-729aeb9859d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:43.726334 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-332e24f3-8630-49f9-9162-729aeb9859d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:43.728456 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-332e24f3-8630-49f9-9162-729aeb9859d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:43.731329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-332e24f3-8630-49f9-9162-729aeb9859d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1723 microversion: 2.20 time: 0.236526 May 16 18:53:43.732333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 323/654] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:43 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:44.326717 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-b3b4066a-7a59-4f47-bff3-8ff34add5dd4 req-e19790b0-add0-4df7-a8de-fdb53ae0a049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de1432f-5419-4150-84a0-0fe456962ce9", "name": "network-vif-deleted", "tag": "eeb3fe2b-d9aa-4852-85f0-2e9f90328234"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:44.337382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-b3b4066a-7a59-4f47-bff3-8ff34add5dd4 req-e19790b0-add0-4df7-a8de-fdb53ae0a049 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:44.339099 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-b3b4066a-7a59-4f47-bff3-8ff34add5dd4 req-e19790b0-add0-4df7-a8de-fdb53ae0a049 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:44.353925 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-b3b4066a-7a59-4f47-bff3-8ff34add5dd4 req-e19790b0-add0-4df7-a8de-fdb53ae0a049 service nova] Creating event network-vif-deleted:eeb3fe2b-d9aa-4852-85f0-2e9f90328234 for instance 4de1432f-5419-4150-84a0-0fe456962ce9 on hv-cinder-75078 May 16 18:53:44.365770 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-b3b4066a-7a59-4f47-bff3-8ff34add5dd4 req-e19790b0-add0-4df7-a8de-fdb53ae0a049 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047492 May 16 18:53:44.366487 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 332/655] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:44.766713 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:44.767518 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:44.775463 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:44.776860 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:44.777668 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:44.778111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:44.830592 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:44.831157 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:44.831748 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lazy-loading 'fault' on Instance uuid 4de1432f-5419-4150-84a0-0fe456962ce9 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:53:44.881161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:44.894501 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:44.897125 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:44.899227 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-fc35d0ea-7490-4e09-849c-ac6d75b965f9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 200 len: 1372 microversion: 2.20 time: 0.139399 May 16 18:53:44.900353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 324/656] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:44 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 1372 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:45.922184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-779c528f-b2ba-4567-bc53-adc9c011d8be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:45.923011 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-779c528f-b2ba-4567-bc53-adc9c011d8be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:45.930831 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-779c528f-b2ba-4567-bc53-adc9c011d8be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:45.931564 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-779c528f-b2ba-4567-bc53-adc9c011d8be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:45.932843 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-779c528f-b2ba-4567-bc53-adc9c011d8be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:45.933167 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-779c528f-b2ba-4567-bc53-adc9c011d8be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:45.949758 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-779c528f-b2ba-4567-bc53-adc9c011d8be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] HTTP exception thrown: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-779c528f-b2ba-4567-bc53-adc9c011d8be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Request method failure captured: May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 HTTP/1.1 May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyPqvNoFylpxYK_UtLaeSas4VI2xl7Mn_ENvadFlg3rgclJdSPgwQtmhu03gctot0XRJFM95yzoj_fkMYwz1g2pVIo-HzvEWJ2meCZHh1wBOSSn9JpCEq5vwsWJUhH3QOW3udvYirDFpwyEXKusamc11ZkAXUpwnMBMhr3Sq4NUXCo May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Openstack-Nova-Api-Version: 2.20 May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:53:45.951452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 8928566ff693460f8243c43078a6a575 May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:53:45.953381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '4de1432f-5419-4150-84a0-0fe456962ce9'} May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:53:45.954353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:53:45.956291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:53:45.958682 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-779c528f-b2ba-4567-bc53-adc9c011d8be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Returning 404 to user: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:53:45.958682 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-779c528f-b2ba-4567-bc53-adc9c011d8be tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 404 len: 111 microversion: 2.20 time: 0.036852 May 16 18:53:45.958682 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 333/657] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:45 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 18:53:45.969935 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3829a9ad-10e2-41c8-8e50-b2679b093995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '.version_select at 0x7f64685f0700>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:45.998582 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3829a9ad-10e2-41c8-8e50-b2679b093995 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130001388" status: 204 len: 0 microversion: 2.20 time: 0.038770 May 16 18:53:45.999661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 325/658] 10.222.0.72 () {60 vars in 1261 bytes} [Mon May 16 18:53:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130001388 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 18:53:46.943240 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-71f587fc-a8e7-4d4b-9edf-6ec2b0795eda tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Action: 'create', calling method: .version_select at 0x7f645be3f0d0>, body: {"keypair": {"name": "tempest-keypair-194357325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKRa5/tJMxIPkIKq1pYD8DOghs0yERqV6vODZuT+KIJjaUbgQ3YrkR1c+EnpkbacnB0oAekJtJ+Lf/+UikxK0AxYzqvvpUr3Mvkb57j6RKUNSzxli/0sByig1AhXX9TVA=="}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:46.957940 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-71f587fc-a8e7-4d4b-9edf-6ec2b0795eda tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Getting quotas for project 67cdad09821341cfa56bbc4642d2cd04. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:53:46.962816 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-71f587fc-a8e7-4d4b-9edf-6ec2b0795eda tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Getting quotas for user 8928566ff693460f8243c43078a6a575 and project 67cdad09821341cfa56bbc4642d2cd04. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:53:46.995738 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-71f587fc-a8e7-4d4b-9edf-6ec2b0795eda tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.187783 May 16 18:53:46.996581 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 334/659] 10.222.0.72 () {62 vars in 1199 bytes} [Mon May 16 18:53:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 190 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 18:53:48.359063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-580356183", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6559b826-317e-418c-bd4b-dba054fded99"}], "security_groups": [{"name": "tempest-securitygroup--282898298"}], "key_name": "tempest-keypair-194357325", "user_data": "}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:48.483787 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] validate_networks() for [('6559b826-317e-418c-bd4b-dba054fded99', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:53:48.893174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:53:48.893636 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:53:48.894122 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:53:48.894535 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:53:48.894973 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:53:48.908194 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:48.908651 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:48.909517 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:48.909965 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:48.927602 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Getting quotas for project 67cdad09821341cfa56bbc4642d2cd04. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:53:48.933125 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Getting quotas for user 8928566ff693460f8243c43078a6a575 and project 67cdad09821341cfa56bbc4642d2cd04. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:53:48.950345 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:53:48.953514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:53:49.026389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-181ac239-66d2-4980-88e2-533a2912aa55 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.672696 May 16 18:53:49.027209 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 326/660] 10.222.0.72 () {62 vars in 1187 bytes} [Mon May 16 18:53:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 18:53:49.042984 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1305da98-e914-4276-829c-81c0aedd134c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:49.045231 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1305da98-e914-4276-829c-81c0aedd134c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:49.110440 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1305da98-e914-4276-829c-81c0aedd134c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:49.117940 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1305da98-e914-4276-829c-81c0aedd134c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:49.119774 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1305da98-e914-4276-829c-81c0aedd134c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:49.121105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1305da98-e914-4276-829c-81c0aedd134c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1280 microversion: 2.20 time: 0.086405 May 16 18:53:49.121721 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 335/661] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:49 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:53:49.493482 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-424952c9-f156-4e49-89db-80ab2add687e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3eaad5d-41ba-42c3-ae6a-8002e0295e56"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:49.494827 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-424952c9-f156-4e49-89db-80ab2add687e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:49.503138 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-424952c9-f156-4e49-89db-80ab2add687e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:49.503600 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-424952c9-f156-4e49-89db-80ab2add687e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:49.504475 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-424952c9-f156-4e49-89db-80ab2add687e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:49.504943 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-424952c9-f156-4e49-89db-80ab2add687e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:49.812601 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-424952c9-f156-4e49-89db-80ab2add687e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323107 May 16 18:53:49.813326 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 327/662] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:53:49 2022] POST /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:50.140436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-dea611e9-3177-48e5-a82e-0cabf3d198d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:50.141073 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-dea611e9-3177-48e5-a82e-0cabf3d198d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:50.148013 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dea611e9-3177-48e5-a82e-0cabf3d198d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:50.148456 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dea611e9-3177-48e5-a82e-0cabf3d198d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:50.149251 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dea611e9-3177-48e5-a82e-0cabf3d198d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:50.149676 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dea611e9-3177-48e5-a82e-0cabf3d198d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:50.230364 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dea611e9-3177-48e5-a82e-0cabf3d198d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:50.239766 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dea611e9-3177-48e5-a82e-0cabf3d198d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:50.241298 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dea611e9-3177-48e5-a82e-0cabf3d198d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:50.242617 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-dea611e9-3177-48e5-a82e-0cabf3d198d9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1332 microversion: 2.20 time: 0.106168 May 16 18:53:50.243353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 336/663] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:50 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:53:51.278439 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-11698e89-fda3-45a7-a70d-23aa6e58ae47 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:51.279567 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-11698e89-fda3-45a7-a70d-23aa6e58ae47 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:51.289174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-11698e89-fda3-45a7-a70d-23aa6e58ae47 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:51.289617 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-11698e89-fda3-45a7-a70d-23aa6e58ae47 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:51.291429 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-11698e89-fda3-45a7-a70d-23aa6e58ae47 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:51.292119 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-11698e89-fda3-45a7-a70d-23aa6e58ae47 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:51.465407 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-11698e89-fda3-45a7-a70d-23aa6e58ae47 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:51.474608 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-11698e89-fda3-45a7-a70d-23aa6e58ae47 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:51.476081 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-11698e89-fda3-45a7-a70d-23aa6e58ae47 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:51.477244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-11698e89-fda3-45a7-a70d-23aa6e58ae47 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1405 microversion: 2.20 time: 0.213447 May 16 18:53:51.477828 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 328/664] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:51 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:52.158563 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-d8585bfa-94a9-4532-9cde-034f99ec47d7 req-0ef01367-94e3-44fa-8300-60cc124903e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b2dd21-9b22-4230-8bee-d6f04f06019f", "tag": "7c023405-87f2-4ed0-9c4c-c419d714714d"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:52.173526 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-d8585bfa-94a9-4532-9cde-034f99ec47d7 req-0ef01367-94e3-44fa-8300-60cc124903e9 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:52.174888 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-d8585bfa-94a9-4532-9cde-034f99ec47d7 req-0ef01367-94e3-44fa-8300-60cc124903e9 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:52.202659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-d8585bfa-94a9-4532-9cde-034f99ec47d7 req-0ef01367-94e3-44fa-8300-60cc124903e9 service nova] Creating event network-changed:7c023405-87f2-4ed0-9c4c-c419d714714d for instance 86b2dd21-9b22-4230-8bee-d6f04f06019f on hv-cinder-75078 May 16 18:53:52.208664 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-d8585bfa-94a9-4532-9cde-034f99ec47d7 req-0ef01367-94e3-44fa-8300-60cc124903e9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053729 May 16 18:53:52.209554 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 337/665] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:52.498457 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-897142bb-b79e-40e5-9e6f-fc89f1ae79eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:52.499220 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-897142bb-b79e-40e5-9e6f-fc89f1ae79eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:52.505886 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-897142bb-b79e-40e5-9e6f-fc89f1ae79eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:52.506332 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-897142bb-b79e-40e5-9e6f-fc89f1ae79eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:52.507104 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-897142bb-b79e-40e5-9e6f-fc89f1ae79eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:52.507559 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-897142bb-b79e-40e5-9e6f-fc89f1ae79eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:52.649181 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-897142bb-b79e-40e5-9e6f-fc89f1ae79eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:52.658881 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-897142bb-b79e-40e5-9e6f-fc89f1ae79eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:52.660419 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-897142bb-b79e-40e5-9e6f-fc89f1ae79eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:52.661550 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-897142bb-b79e-40e5-9e6f-fc89f1ae79eb tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1405 microversion: 2.20 time: 0.167019 May 16 18:53:52.662451 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 329/666] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:52 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:53.681543 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3d52cb95-b6ee-4b30-a15c-b5548af4f9a4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:53.682403 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3d52cb95-b6ee-4b30-a15c-b5548af4f9a4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:53.691382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d52cb95-b6ee-4b30-a15c-b5548af4f9a4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:53.692221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d52cb95-b6ee-4b30-a15c-b5548af4f9a4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:53.693620 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d52cb95-b6ee-4b30-a15c-b5548af4f9a4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:53.694280 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d52cb95-b6ee-4b30-a15c-b5548af4f9a4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:53.845837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3d52cb95-b6ee-4b30-a15c-b5548af4f9a4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:53.854941 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3d52cb95-b6ee-4b30-a15c-b5548af4f9a4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:53.856543 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3d52cb95-b6ee-4b30-a15c-b5548af4f9a4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:53.857663 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3d52cb95-b6ee-4b30-a15c-b5548af4f9a4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1405 microversion: 2.20 time: 0.180978 May 16 18:53:53.858273 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 338/667] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:53 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:54.876545 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b5c7be6f-488b-410e-b0c1-65b272db7347 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:54.877241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b5c7be6f-488b-410e-b0c1-65b272db7347 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:54.883791 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b5c7be6f-488b-410e-b0c1-65b272db7347 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:54.884239 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b5c7be6f-488b-410e-b0c1-65b272db7347 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:54.885453 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b5c7be6f-488b-410e-b0c1-65b272db7347 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:54.885884 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b5c7be6f-488b-410e-b0c1-65b272db7347 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:55.031151 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b5c7be6f-488b-410e-b0c1-65b272db7347 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:55.039662 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b5c7be6f-488b-410e-b0c1-65b272db7347 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:55.041744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b5c7be6f-488b-410e-b0c1-65b272db7347 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:55.043373 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b5c7be6f-488b-410e-b0c1-65b272db7347 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1405 microversion: 2.20 time: 0.170804 May 16 18:53:55.044063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 330/668] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:54 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:56.062132 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f2fdb759-da62-479c-bb0f-751abf0b0baa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:56.062760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f2fdb759-da62-479c-bb0f-751abf0b0baa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:56.069302 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f2fdb759-da62-479c-bb0f-751abf0b0baa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:56.069756 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f2fdb759-da62-479c-bb0f-751abf0b0baa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:56.070551 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f2fdb759-da62-479c-bb0f-751abf0b0baa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:56.070992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f2fdb759-da62-479c-bb0f-751abf0b0baa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:56.240801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f2fdb759-da62-479c-bb0f-751abf0b0baa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:56.262932 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f2fdb759-da62-479c-bb0f-751abf0b0baa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:56.265819 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f2fdb759-da62-479c-bb0f-751abf0b0baa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:56.267911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f2fdb759-da62-479c-bb0f-751abf0b0baa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1405 microversion: 2.20 time: 0.209400 May 16 18:53:56.268987 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 339/669] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:56 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:57.293939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-29e7f4fb-dffd-47a8-8d54-306c9706fabd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:57.294683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-29e7f4fb-dffd-47a8-8d54-306c9706fabd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:57.301217 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29e7f4fb-dffd-47a8-8d54-306c9706fabd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:57.301671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29e7f4fb-dffd-47a8-8d54-306c9706fabd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:57.302450 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29e7f4fb-dffd-47a8-8d54-306c9706fabd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:57.302889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29e7f4fb-dffd-47a8-8d54-306c9706fabd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:57.444057 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a29ad781-6238-4c16-8b4c-68d66e4f23a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:57.445007 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a29ad781-6238-4c16-8b4c-68d66e4f23a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:57.452197 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a29ad781-6238-4c16-8b4c-68d66e4f23a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:57.452657 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a29ad781-6238-4c16-8b4c-68d66e4f23a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:57.453436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a29ad781-6238-4c16-8b4c-68d66e4f23a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:57.453872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a29ad781-6238-4c16-8b4c-68d66e4f23a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:57.468685 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-29e7f4fb-dffd-47a8-8d54-306c9706fabd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:57.479339 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-a29ad781-6238-4c16-8b4c-68d66e4f23a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lazy-loading 'flavor' on Instance uuid 08296f7c-a2cd-4a66-9f47-ae72714a4e37 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:53:57.479950 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-29e7f4fb-dffd-47a8-8d54-306c9706fabd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:57.480688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-29e7f4fb-dffd-47a8-8d54-306c9706fabd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:57.481928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-29e7f4fb-dffd-47a8-8d54-306c9706fabd tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1405 microversion: 2.20 time: 0.192192 May 16 18:53:57.482488 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 331/670] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:57 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:57.613834 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a29ad781-6238-4c16-8b4c-68d66e4f23a4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/action" status: 200 len: 32 microversion: 2.1 time: 0.174026 May 16 18:53:57.614462 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 340/671] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:53:57 2022] POST /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 18:53:57.624374 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-95f2af8b-a987-4353-b8d0-f85fa336fec4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:57.625011 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-95f2af8b-a987-4353-b8d0-f85fa336fec4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:57.631099 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95f2af8b-a987-4353-b8d0-f85fa336fec4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:57.631546 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95f2af8b-a987-4353-b8d0-f85fa336fec4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:57.632404 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95f2af8b-a987-4353-b8d0-f85fa336fec4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:57.632845 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95f2af8b-a987-4353-b8d0-f85fa336fec4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:57.790334 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-95f2af8b-a987-4353-b8d0-f85fa336fec4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:57.800206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-95f2af8b-a987-4353-b8d0-f85fa336fec4 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.179485 May 16 18:53:57.800794 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 332/672] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:57 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:58.215957 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-c117d115-307c-4793-abfc-4a648b84e59f req-d2ae9bc7-83d2-419f-9628-d6b59b2bd535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b2dd21-9b22-4230-8bee-d6f04f06019f", "name": "network-vif-plugged", "status": "completed", "tag": "7c023405-87f2-4ed0-9c4c-c419d714714d"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:53:58.225199 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-c117d115-307c-4793-abfc-4a648b84e59f req-d2ae9bc7-83d2-419f-9628-d6b59b2bd535 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:58.225657 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-c117d115-307c-4793-abfc-4a648b84e59f req-d2ae9bc7-83d2-419f-9628-d6b59b2bd535 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:58.247371 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-c117d115-307c-4793-abfc-4a648b84e59f req-d2ae9bc7-83d2-419f-9628-d6b59b2bd535 service nova] Creating event network-vif-plugged:7c023405-87f2-4ed0-9c4c-c419d714714d for instance 86b2dd21-9b22-4230-8bee-d6f04f06019f on hv-cinder-75078 May 16 18:53:58.253667 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-c117d115-307c-4793-abfc-4a648b84e59f req-d2ae9bc7-83d2-419f-9628-d6b59b2bd535 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044569 May 16 18:53:58.254543 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 341/673] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:53:58.500759 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e73516aa-79cc-43c2-9c42-d9f2e24014aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:58.501581 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e73516aa-79cc-43c2-9c42-d9f2e24014aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:58.508296 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e73516aa-79cc-43c2-9c42-d9f2e24014aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:58.508750 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e73516aa-79cc-43c2-9c42-d9f2e24014aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:58.510086 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e73516aa-79cc-43c2-9c42-d9f2e24014aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:58.510764 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e73516aa-79cc-43c2-9c42-d9f2e24014aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:58.679019 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e73516aa-79cc-43c2-9c42-d9f2e24014aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:58.688594 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e73516aa-79cc-43c2-9c42-d9f2e24014aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:58.690133 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e73516aa-79cc-43c2-9c42-d9f2e24014aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:58.691285 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e73516aa-79cc-43c2-9c42-d9f2e24014aa tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1405 microversion: 2.20 time: 0.194827 May 16 18:53:58.691867 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 333/674] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:58 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:53:58.820248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a6baa45d-9a44-4ffc-b1f5-148ea329b803 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:58.820879 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a6baa45d-9a44-4ffc-b1f5-148ea329b803 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:58.827307 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6baa45d-9a44-4ffc-b1f5-148ea329b803 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:58.827783 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6baa45d-9a44-4ffc-b1f5-148ea329b803 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:58.828572 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6baa45d-9a44-4ffc-b1f5-148ea329b803 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:58.829011 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6baa45d-9a44-4ffc-b1f5-148ea329b803 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:58.997225 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a6baa45d-9a44-4ffc-b1f5-148ea329b803 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:59.008198 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a6baa45d-9a44-4ffc-b1f5-148ea329b803 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.192971 May 16 18:53:59.008794 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 342/675] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:53:58 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:53:59.712504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-29fe6097-17cd-4f02-b7fb-d20684e2a72d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:53:59.713526 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-29fe6097-17cd-4f02-b7fb-d20684e2a72d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:53:59.724606 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29fe6097-17cd-4f02-b7fb-d20684e2a72d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:59.725376 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29fe6097-17cd-4f02-b7fb-d20684e2a72d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:59.726468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29fe6097-17cd-4f02-b7fb-d20684e2a72d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:53:59.727103 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-29fe6097-17cd-4f02-b7fb-d20684e2a72d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:53:59.894285 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-29fe6097-17cd-4f02-b7fb-d20684e2a72d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:59.906678 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-29fe6097-17cd-4f02-b7fb-d20684e2a72d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:59.908222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-29fe6097-17cd-4f02-b7fb-d20684e2a72d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:53:59.909366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-29fe6097-17cd-4f02-b7fb-d20684e2a72d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1405 microversion: 2.20 time: 0.202962 May 16 18:53:59.910073 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 334/676] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:53:59 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:54:00.026864 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-288c58cf-1296-4e70-bac8-b9ce639bea08 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:00.027613 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-288c58cf-1296-4e70-bac8-b9ce639bea08 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:00.037127 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-288c58cf-1296-4e70-bac8-b9ce639bea08 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:00.037577 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-288c58cf-1296-4e70-bac8-b9ce639bea08 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:00.038365 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-288c58cf-1296-4e70-bac8-b9ce639bea08 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:00.038795 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-288c58cf-1296-4e70-bac8-b9ce639bea08 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:00.206369 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-288c58cf-1296-4e70-bac8-b9ce639bea08 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:00.219038 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-288c58cf-1296-4e70-bac8-b9ce639bea08 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.195964 May 16 18:54:00.219593 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 343/677] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:00 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:00.928629 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a2ef854a-7d84-4e5f-987f-5f051297231f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:00.929442 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a2ef854a-7d84-4e5f-987f-5f051297231f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:00.936939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a2ef854a-7d84-4e5f-987f-5f051297231f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:00.937484 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a2ef854a-7d84-4e5f-987f-5f051297231f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:00.938283 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a2ef854a-7d84-4e5f-987f-5f051297231f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:00.938730 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a2ef854a-7d84-4e5f-987f-5f051297231f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:01.103828 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a2ef854a-7d84-4e5f-987f-5f051297231f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:01.112397 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a2ef854a-7d84-4e5f-987f-5f051297231f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:01.113899 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a2ef854a-7d84-4e5f-987f-5f051297231f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:01.115056 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a2ef854a-7d84-4e5f-987f-5f051297231f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1596 microversion: 2.20 time: 0.190830 May 16 18:54:01.115650 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 335/678] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:54:00 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1596 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:54:01.137780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3dfecd63-d910-4d15-81c1-8cc006a15f5d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:01.138339 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3dfecd63-d910-4d15-81c1-8cc006a15f5d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:01.146168 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3dfecd63-d910-4d15-81c1-8cc006a15f5d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:01.146621 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3dfecd63-d910-4d15-81c1-8cc006a15f5d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:01.147398 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3dfecd63-d910-4d15-81c1-8cc006a15f5d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:01.147893 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3dfecd63-d910-4d15-81c1-8cc006a15f5d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:01.244243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4ef63a80-f3c0-4f7d-9851-8cd905d03563 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:01.244874 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4ef63a80-f3c0-4f7d-9851-8cd905d03563 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:01.245810 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3dfecd63-d910-4d15-81c1-8cc006a15f5d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111701 May 16 18:54:01.246510 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 344/679] 10.222.0.72 () {60 vars in 1315 bytes} [Mon May 16 18:54:01 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:54:01.252420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ef63a80-f3c0-4f7d-9851-8cd905d03563 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:01.252420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ef63a80-f3c0-4f7d-9851-8cd905d03563 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:01.252420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ef63a80-f3c0-4f7d-9851-8cd905d03563 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:01.257931 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4ef63a80-f3c0-4f7d-9851-8cd905d03563 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:01.542385 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4ef63a80-f3c0-4f7d-9851-8cd905d03563 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:01.552540 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4ef63a80-f3c0-4f7d-9851-8cd905d03563 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.312943 May 16 18:54:01.553309 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 336/680] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:01 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:02.438410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-f0afa30d-8fe6-4e6e-9b2b-6718f8488db7 req-01b79df9-1903-4989-ad00-fe3d78ffe5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b2dd21-9b22-4230-8bee-d6f04f06019f", "tag": "7c023405-87f2-4ed0-9c4c-c419d714714d"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:02.448580 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-f0afa30d-8fe6-4e6e-9b2b-6718f8488db7 req-01b79df9-1903-4989-ad00-fe3d78ffe5f4 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:02.449254 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-f0afa30d-8fe6-4e6e-9b2b-6718f8488db7 req-01b79df9-1903-4989-ad00-fe3d78ffe5f4 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:02.461593 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-f0afa30d-8fe6-4e6e-9b2b-6718f8488db7 req-01b79df9-1903-4989-ad00-fe3d78ffe5f4 service nova] Creating event network-changed:7c023405-87f2-4ed0-9c4c-c419d714714d for instance 86b2dd21-9b22-4230-8bee-d6f04f06019f on hv-cinder-75078 May 16 18:54:02.472761 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-f0afa30d-8fe6-4e6e-9b2b-6718f8488db7 req-01b79df9-1903-4989-ad00-fe3d78ffe5f4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042268 May 16 18:54:02.473391 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 345/681] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:02.571135 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4861701b-f6a3-46aa-aad8-5bfb7aee9945 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:02.571876 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4861701b-f6a3-46aa-aad8-5bfb7aee9945 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:02.580788 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4861701b-f6a3-46aa-aad8-5bfb7aee9945 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:02.581848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4861701b-f6a3-46aa-aad8-5bfb7aee9945 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:02.583025 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4861701b-f6a3-46aa-aad8-5bfb7aee9945 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:02.583840 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4861701b-f6a3-46aa-aad8-5bfb7aee9945 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:02.781797 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4861701b-f6a3-46aa-aad8-5bfb7aee9945 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:02.796052 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4861701b-f6a3-46aa-aad8-5bfb7aee9945 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.228804 May 16 18:54:02.797157 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 337/682] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:02 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:03.833545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-986bffe1-131d-4fa7-a3d2-bedd1d9b6b05 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:03.834732 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-986bffe1-131d-4fa7-a3d2-bedd1d9b6b05 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:03.846757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-986bffe1-131d-4fa7-a3d2-bedd1d9b6b05 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:03.846757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-986bffe1-131d-4fa7-a3d2-bedd1d9b6b05 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:03.848716 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-986bffe1-131d-4fa7-a3d2-bedd1d9b6b05 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:03.848716 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-986bffe1-131d-4fa7-a3d2-bedd1d9b6b05 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:03.997436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-986bffe1-131d-4fa7-a3d2-bedd1d9b6b05 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:04.010727 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-986bffe1-131d-4fa7-a3d2-bedd1d9b6b05 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.189936 May 16 18:54:04.011332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 346/683] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:03 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:05.034787 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c8ffe576-7f89-4acc-b6a5-10de21048717 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:05.035758 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c8ffe576-7f89-4acc-b6a5-10de21048717 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:05.043564 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c8ffe576-7f89-4acc-b6a5-10de21048717 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:05.044065 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c8ffe576-7f89-4acc-b6a5-10de21048717 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:05.044937 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c8ffe576-7f89-4acc-b6a5-10de21048717 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:05.045384 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c8ffe576-7f89-4acc-b6a5-10de21048717 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:05.197391 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c8ffe576-7f89-4acc-b6a5-10de21048717 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:05.206383 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c8ffe576-7f89-4acc-b6a5-10de21048717 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.176382 May 16 18:54:05.206964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 338/684] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:05 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:06.226741 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3dac65f5-ca12-433e-97b4-c84d4b690de1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:06.227469 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3dac65f5-ca12-433e-97b4-c84d4b690de1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:06.233863 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3dac65f5-ca12-433e-97b4-c84d4b690de1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:06.234306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3dac65f5-ca12-433e-97b4-c84d4b690de1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:06.235077 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3dac65f5-ca12-433e-97b4-c84d4b690de1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:06.235503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3dac65f5-ca12-433e-97b4-c84d4b690de1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:06.381638 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3dac65f5-ca12-433e-97b4-c84d4b690de1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:06.390881 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3dac65f5-ca12-433e-97b4-c84d4b690de1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.168229 May 16 18:54:06.391727 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 347/685] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:06 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:07.412595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0bbb9d38-2eb5-4e41-89a7-5bf7ce929b4e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:07.413199 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0bbb9d38-2eb5-4e41-89a7-5bf7ce929b4e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:07.420426 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0bbb9d38-2eb5-4e41-89a7-5bf7ce929b4e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:07.420869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0bbb9d38-2eb5-4e41-89a7-5bf7ce929b4e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:07.421631 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0bbb9d38-2eb5-4e41-89a7-5bf7ce929b4e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:07.422061 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0bbb9d38-2eb5-4e41-89a7-5bf7ce929b4e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:07.567355 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0bbb9d38-2eb5-4e41-89a7-5bf7ce929b4e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:07.576324 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0bbb9d38-2eb5-4e41-89a7-5bf7ce929b4e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.167618 May 16 18:54:07.576890 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 339/686] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:07 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:08.594515 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b94c00aa-8cb7-4e6a-9eed-21a4030e4e85 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:08.596097 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b94c00aa-8cb7-4e6a-9eed-21a4030e4e85 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:08.604092 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b94c00aa-8cb7-4e6a-9eed-21a4030e4e85 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:08.604546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b94c00aa-8cb7-4e6a-9eed-21a4030e4e85 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:08.605332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b94c00aa-8cb7-4e6a-9eed-21a4030e4e85 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:08.607876 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b94c00aa-8cb7-4e6a-9eed-21a4030e4e85 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:08.749489 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b94c00aa-8cb7-4e6a-9eed-21a4030e4e85 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:08.757608 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b94c00aa-8cb7-4e6a-9eed-21a4030e4e85 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.167209 May 16 18:54:08.758191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 348/687] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:08 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:09.779844 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-df7c59e3-1ec7-4040-b3f5-19ee20fc3680 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:09.781693 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-df7c59e3-1ec7-4040-b3f5-19ee20fc3680 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:09.787949 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-df7c59e3-1ec7-4040-b3f5-19ee20fc3680 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:09.788397 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-df7c59e3-1ec7-4040-b3f5-19ee20fc3680 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:09.789169 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-df7c59e3-1ec7-4040-b3f5-19ee20fc3680 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:09.789603 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-df7c59e3-1ec7-4040-b3f5-19ee20fc3680 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:09.935850 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-df7c59e3-1ec7-4040-b3f5-19ee20fc3680 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:09.944098 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-df7c59e3-1ec7-4040-b3f5-19ee20fc3680 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.168690 May 16 18:54:09.945351 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 340/688] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:09 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:10.965189 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-38aad7aa-c953-4272-8aa3-3221ea7a3d5a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:10.966961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-38aad7aa-c953-4272-8aa3-3221ea7a3d5a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:10.975447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-38aad7aa-c953-4272-8aa3-3221ea7a3d5a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:10.975946 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-38aad7aa-c953-4272-8aa3-3221ea7a3d5a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:10.976737 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-38aad7aa-c953-4272-8aa3-3221ea7a3d5a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:10.977263 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-38aad7aa-c953-4272-8aa3-3221ea7a3d5a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:11.137565 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-38aad7aa-c953-4272-8aa3-3221ea7a3d5a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:11.148059 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-38aad7aa-c953-4272-8aa3-3221ea7a3d5a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1734 microversion: 2.1 time: 0.189300 May 16 18:54:11.148626 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 349/689] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:10 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:12.167348 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-99ed4c0f-bb14-4ca8-b561-9b32e5c8c381 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:12.167952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-99ed4c0f-bb14-4ca8-b561-9b32e5c8c381 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:12.175048 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-99ed4c0f-bb14-4ca8-b561-9b32e5c8c381 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:12.175522 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-99ed4c0f-bb14-4ca8-b561-9b32e5c8c381 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:12.176323 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-99ed4c0f-bb14-4ca8-b561-9b32e5c8c381 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:12.176772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-99ed4c0f-bb14-4ca8-b561-9b32e5c8c381 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:12.327372 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-99ed4c0f-bb14-4ca8-b561-9b32e5c8c381 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:12.339703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-99ed4c0f-bb14-4ca8-b561-9b32e5c8c381 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1714 microversion: 2.1 time: 0.176532 May 16 18:54:12.340301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 341/690] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:12 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1714 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:12.449864 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d460e609-6351-479b-a51c-c769ce12fb65 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:12.450380 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d460e609-6351-479b-a51c-c769ce12fb65 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:12.456765 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d460e609-6351-479b-a51c-c769ce12fb65 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:12.457217 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d460e609-6351-479b-a51c-c769ce12fb65 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:12.458124 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d460e609-6351-479b-a51c-c769ce12fb65 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:12.458443 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d460e609-6351-479b-a51c-c769ce12fb65 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:12.552974 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-d460e609-6351-479b-a51c-c769ce12fb65 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] HTTP exception thrown: Cannot 'detach_volume' instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 while it is in vm_state rescued May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d460e609-6351-479b-a51c-c769ce12fb65 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Request method failure captured: May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: DELETE /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments/e3eaad5d-41ba-42c3-ae6a-8002e0295e56 HTTP/1.1 May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpzg_Pwgwncj8s5c-vohUPtNAuGaR132lrZYw_aU8QzfdorNmdIes6ufMp_OpEpKC8RJG-tNmWB2qOSEHIYoYS2_ry6eMVKghmNBWXn50nOzP_tfjsnxTAesZPSPNnVmxEieajJZdqMpkVwbQctsn13iD0NMbnMI0cGFqADMHG_Pgqw May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 9fe0e3c0f5eb4d4199f084be233eb1d3 May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:54:12.556748 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 9fe0e3c0f5eb4d4199f084be233eb1d3 May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-ServerRescueNegativeTestJSON-130323987-project May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 89539508b327427ba1a449fe30569606 May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-130323987-project May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:54:12.559362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Cannot 'detach_volume' instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 while it is in vm_state rescued May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'server_id': '08296f7c-a2cd-4a66-9f47-ae72714a4e37', 'id': 'e3eaad5d-41ba-42c3-ae6a-8002e0295e56'} May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:54:12.560915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 while it is in vm_state rescued May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 while it is in vm_state rescued May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:12.564010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d460e609-6351-479b-a51c-c769ce12fb65 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Returning 409 to user: Cannot 'detach_volume' instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 while it is in vm_state rescued {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:54:12.566171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d460e609-6351-479b-a51c-c769ce12fb65 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "DELETE /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments/e3eaad5d-41ba-42c3-ae6a-8002e0295e56" status: 409 len: 152 microversion: 2.1 time: 0.114761 May 16 18:54:12.566171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 350/691] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 18:54:12 2022] DELETE /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments/e3eaad5d-41ba-42c3-ae6a-8002e0295e56 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 16 18:54:12.570608 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-501b4039-d2a5-4f2d-b01b-e73b21d826da tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:12.571177 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-501b4039-d2a5-4f2d-b01b-e73b21d826da tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:12.578116 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-501b4039-d2a5-4f2d-b01b-e73b21d826da tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:12.578565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-501b4039-d2a5-4f2d-b01b-e73b21d826da tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:12.579339 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-501b4039-d2a5-4f2d-b01b-e73b21d826da tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:12.579817 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-501b4039-d2a5-4f2d-b01b-e73b21d826da tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:12.651664 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-501b4039-d2a5-4f2d-b01b-e73b21d826da tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "POST /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/action" status: 202 len: 0 microversion: 2.1 time: 0.087508 May 16 18:54:12.652335 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 342/692] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:54:12 2022] POST /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 18:54:12.662362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-07fc2097-1e05-40de-9180-c421921485dd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:12.663134 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-07fc2097-1e05-40de-9180-c421921485dd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:12.672206 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-07fc2097-1e05-40de-9180-c421921485dd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:12.672750 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-07fc2097-1e05-40de-9180-c421921485dd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:12.673593 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-07fc2097-1e05-40de-9180-c421921485dd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:12.674200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-07fc2097-1e05-40de-9180-c421921485dd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:12.836460 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-07fc2097-1e05-40de-9180-c421921485dd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:12.852938 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-07fc2097-1e05-40de-9180-c421921485dd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1722 microversion: 2.1 time: 0.195460 May 16 18:54:12.854075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 351/693] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:12 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:13.874940 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-82f3c5cd-bffd-44c9-aaa5-c63333aeb815 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:13.875700 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-82f3c5cd-bffd-44c9-aaa5-c63333aeb815 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:13.886230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-82f3c5cd-bffd-44c9-aaa5-c63333aeb815 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:13.886677 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-82f3c5cd-bffd-44c9-aaa5-c63333aeb815 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:13.887506 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-82f3c5cd-bffd-44c9-aaa5-c63333aeb815 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:13.887955 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-82f3c5cd-bffd-44c9-aaa5-c63333aeb815 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:14.043358 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-82f3c5cd-bffd-44c9-aaa5-c63333aeb815 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:14.051421 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-82f3c5cd-bffd-44c9-aaa5-c63333aeb815 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1722 microversion: 2.1 time: 0.181380 May 16 18:54:14.052043 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 343/694] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:13 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:15.072618 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-73c4913a-3d00-4a9b-857a-37dc6c0b0021 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:15.073787 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-73c4913a-3d00-4a9b-857a-37dc6c0b0021 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:15.085508 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-73c4913a-3d00-4a9b-857a-37dc6c0b0021 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:15.086324 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-73c4913a-3d00-4a9b-857a-37dc6c0b0021 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:15.088031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-73c4913a-3d00-4a9b-857a-37dc6c0b0021 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:15.088902 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-73c4913a-3d00-4a9b-857a-37dc6c0b0021 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:15.237272 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-73c4913a-3d00-4a9b-857a-37dc6c0b0021 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:15.246598 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-73c4913a-3d00-4a9b-857a-37dc6c0b0021 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1722 microversion: 2.1 time: 0.180797 May 16 18:54:15.247169 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 352/695] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:15 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:16.264033 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-826b8967-e8db-4d83-9fba-594aca8a661c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:16.264572 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-826b8967-e8db-4d83-9fba-594aca8a661c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:16.271354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-826b8967-e8db-4d83-9fba-594aca8a661c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:16.271830 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-826b8967-e8db-4d83-9fba-594aca8a661c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:16.272611 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-826b8967-e8db-4d83-9fba-594aca8a661c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:16.273045 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-826b8967-e8db-4d83-9fba-594aca8a661c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:16.410264 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-826b8967-e8db-4d83-9fba-594aca8a661c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:16.419120 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-826b8967-e8db-4d83-9fba-594aca8a661c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1728 microversion: 2.1 time: 0.158975 May 16 18:54:16.419703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 344/696] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:16 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:16.436201 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3de6cd1e-a908-419e-a109-8d5f5d0c3229 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:16.436935 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3de6cd1e-a908-419e-a109-8d5f5d0c3229 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:16.444030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3de6cd1e-a908-419e-a109-8d5f5d0c3229 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:16.444477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3de6cd1e-a908-419e-a109-8d5f5d0c3229 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:16.445309 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3de6cd1e-a908-419e-a109-8d5f5d0c3229 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:16.445874 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3de6cd1e-a908-419e-a109-8d5f5d0c3229 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:16.526829 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3de6cd1e-a908-419e-a109-8d5f5d0c3229 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094553 May 16 18:54:16.527301 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 353/697] 10.222.0.72 () {58 vars in 1274 bytes} [Mon May 16 18:54:16 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:17.244050 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-fffb6fc2-dd51-45e1-898e-4cf35a29bd07 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:17.244548 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-fffb6fc2-dd51-45e1-898e-4cf35a29bd07 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:17.250497 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fffb6fc2-dd51-45e1-898e-4cf35a29bd07 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:17.250953 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fffb6fc2-dd51-45e1-898e-4cf35a29bd07 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:17.251769 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fffb6fc2-dd51-45e1-898e-4cf35a29bd07 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:17.252182 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-fffb6fc2-dd51-45e1-898e-4cf35a29bd07 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:17.278286 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-fffb6fc2-dd51-45e1-898e-4cf35a29bd07 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/ips" status: 200 len: 150 microversion: 2.1 time: 0.099736 May 16 18:54:17.284037 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 345/698] 10.222.0.72 () {58 vars in 1247 bytes} [Mon May 16 18:54:17 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/ips => generated 150 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:17.610277 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f4a00c0c-0167-4fce-bab1-3d5e382e81e4 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:17.611695 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f4a00c0c-0167-4fce-bab1-3d5e382e81e4 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:17.624281 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f4a00c0c-0167-4fce-bab1-3d5e382e81e4 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:17.625364 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f4a00c0c-0167-4fce-bab1-3d5e382e81e4 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:17.627299 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f4a00c0c-0167-4fce-bab1-3d5e382e81e4 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:17.628341 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f4a00c0c-0167-4fce-bab1-3d5e382e81e4 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:17.666676 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-f4a00c0c-0167-4fce-bab1-3d5e382e81e4 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lazy-loading 'flavor' on Instance uuid 12aa2a80-3944-4ff6-9b34-ada2debe18c5 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:54:17.777997 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f4a00c0c-0167-4fce-bab1-3d5e382e81e4 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "POST /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5/action" status: 202 len: 0 microversion: 2.1 time: 0.172233 May 16 18:54:17.778992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 354/699] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:54:17 2022] POST /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:54:17.793074 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-58db15a2-ec30-4632-9391-700a2139776b tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:17.794562 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-58db15a2-ec30-4632-9391-700a2139776b tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:17.804944 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58db15a2-ec30-4632-9391-700a2139776b tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:17.805724 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58db15a2-ec30-4632-9391-700a2139776b tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:17.807105 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58db15a2-ec30-4632-9391-700a2139776b tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:17.807910 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58db15a2-ec30-4632-9391-700a2139776b tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:17.862246 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-1cd97fcd-bbb3-4d20-b8f4-157d06416316 req-6287aaa8-335f-423d-bfb8-e5addbe8cdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08296f7c-a2cd-4a66-9f47-ae72714a4e37", "tag": "beee622c-240e-41d7-b32d-a07b68814889"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:17.880715 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-1cd97fcd-bbb3-4d20-b8f4-157d06416316 req-6287aaa8-335f-423d-bfb8-e5addbe8cdf6 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:17.881788 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-1cd97fcd-bbb3-4d20-b8f4-157d06416316 req-6287aaa8-335f-423d-bfb8-e5addbe8cdf6 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:17.905912 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-1cd97fcd-bbb3-4d20-b8f4-157d06416316 req-6287aaa8-335f-423d-bfb8-e5addbe8cdf6 service nova] Creating event network-changed:beee622c-240e-41d7-b32d-a07b68814889 for instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 on hv-cinder-75078 May 16 18:54:17.913121 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-1cd97fcd-bbb3-4d20-b8f4-157d06416316 req-6287aaa8-335f-423d-bfb8-e5addbe8cdf6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067174 May 16 18:54:17.914190 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 355/700] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:18.014522 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-58db15a2-ec30-4632-9391-700a2139776b tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:18.023474 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-58db15a2-ec30-4632-9391-700a2139776b tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.239291 May 16 18:54:18.024343 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 346/701] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:17 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:18.736425 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-66d83df6-fb87-4398-80a2-b850947411b2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06bf90e5-56b2-45f9-856c-339f30af8c35"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:18.738642 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-66d83df6-fb87-4398-80a2-b850947411b2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:18.750647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-66d83df6-fb87-4398-80a2-b850947411b2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:18.751551 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-66d83df6-fb87-4398-80a2-b850947411b2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:18.753043 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-66d83df6-fb87-4398-80a2-b850947411b2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:18.753905 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-66d83df6-fb87-4398-80a2-b850947411b2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:19.046173 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c26791a6-b607-4c25-b82e-a837ac9e14a6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:19.046816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c26791a6-b607-4c25-b82e-a837ac9e14a6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:19.054008 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c26791a6-b607-4c25-b82e-a837ac9e14a6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:19.054485 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c26791a6-b607-4c25-b82e-a837ac9e14a6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:19.055247 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c26791a6-b607-4c25-b82e-a837ac9e14a6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:19.055937 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c26791a6-b607-4c25-b82e-a837ac9e14a6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:19.064700 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-66d83df6-fb87-4398-80a2-b850947411b2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337855 May 16 18:54:19.065840 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 356/702] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:54:18 2022] POST /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:19.240519 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c26791a6-b607-4c25-b82e-a837ac9e14a6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:19.249103 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c26791a6-b607-4c25-b82e-a837ac9e14a6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.207937 May 16 18:54:19.249705 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 347/703] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:19 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:19.933638 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-273fa6b1-e177-4335-ac6c-3b219c61ce6b req-d9cf9677-0b00-4e32-af08-ce01275e9d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08296f7c-a2cd-4a66-9f47-ae72714a4e37", "tag": "beee622c-240e-41d7-b32d-a07b68814889"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:19.943048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-273fa6b1-e177-4335-ac6c-3b219c61ce6b req-d9cf9677-0b00-4e32-af08-ce01275e9d88 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:19.943497 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-273fa6b1-e177-4335-ac6c-3b219c61ce6b req-d9cf9677-0b00-4e32-af08-ce01275e9d88 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:19.961282 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-273fa6b1-e177-4335-ac6c-3b219c61ce6b req-d9cf9677-0b00-4e32-af08-ce01275e9d88 service nova] Creating event network-changed:beee622c-240e-41d7-b32d-a07b68814889 for instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 on hv-cinder-75078 May 16 18:54:19.968906 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-273fa6b1-e177-4335-ac6c-3b219c61ce6b req-d9cf9677-0b00-4e32-af08-ce01275e9d88 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039488 May 16 18:54:19.969518 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 357/704] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:20.269796 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9b607310-46d9-4b3b-855b-60708092fa21 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:20.270597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9b607310-46d9-4b3b-855b-60708092fa21 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:20.277224 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9b607310-46d9-4b3b-855b-60708092fa21 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:20.277681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9b607310-46d9-4b3b-855b-60708092fa21 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:20.278447 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9b607310-46d9-4b3b-855b-60708092fa21 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:20.278876 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9b607310-46d9-4b3b-855b-60708092fa21 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:20.495737 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9b607310-46d9-4b3b-855b-60708092fa21 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:20.505680 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9b607310-46d9-4b3b-855b-60708092fa21 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.239988 May 16 18:54:20.506817 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 348/705] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:20 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:20.529229 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1684399a-3771-4ebd-a905-f0a5ae5ddd03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:20.530520 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1684399a-3771-4ebd-a905-f0a5ae5ddd03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:20.538209 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1684399a-3771-4ebd-a905-f0a5ae5ddd03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:20.538784 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1684399a-3771-4ebd-a905-f0a5ae5ddd03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:20.539666 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1684399a-3771-4ebd-a905-f0a5ae5ddd03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:20.540809 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1684399a-3771-4ebd-a905-f0a5ae5ddd03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:20.572494 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1684399a-3771-4ebd-a905-f0a5ae5ddd03 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049509 May 16 18:54:20.573069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 358/706] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:54:20 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 18:54:20.650584 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6cf24d51-5d30-4997-bdac-41b7b33edabd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:20.651068 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6cf24d51-5d30-4997-bdac-41b7b33edabd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:20.657245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6cf24d51-5d30-4997-bdac-41b7b33edabd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:20.657814 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6cf24d51-5d30-4997-bdac-41b7b33edabd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:20.658645 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6cf24d51-5d30-4997-bdac-41b7b33edabd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:20.659121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6cf24d51-5d30-4997-bdac-41b7b33edabd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:20.684400 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6cf24d51-5d30-4997-bdac-41b7b33edabd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:54:20.769720 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6cf24d51-5d30-4997-bdac-41b7b33edabd tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 204 len: 0 microversion: 2.1 time: 0.123172 May 16 18:54:20.770444 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 349/707] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:54:20 2022] DELETE /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:54:20.781525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-96049436-d55b-440f-b5ec-3c3213c983e6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:20.782221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-96049436-d55b-440f-b5ec-3c3213c983e6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:20.789349 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-96049436-d55b-440f-b5ec-3c3213c983e6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:20.789799 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-96049436-d55b-440f-b5ec-3c3213c983e6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:20.791220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-96049436-d55b-440f-b5ec-3c3213c983e6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:20.791774 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-96049436-d55b-440f-b5ec-3c3213c983e6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:20.942801 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-96049436-d55b-440f-b5ec-3c3213c983e6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:20.953971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-96049436-d55b-440f-b5ec-3c3213c983e6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1671 microversion: 2.1 time: 0.176287 May 16 18:54:20.954981 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 359/708] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:20 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:21.530034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ca71bc32-bc38-4de0-90d7-aa3df05ce0de tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:21.530717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ca71bc32-bc38-4de0-90d7-aa3df05ce0de tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:21.537514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ca71bc32-bc38-4de0-90d7-aa3df05ce0de tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:21.538012 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ca71bc32-bc38-4de0-90d7-aa3df05ce0de tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:21.538914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ca71bc32-bc38-4de0-90d7-aa3df05ce0de tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:21.539397 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ca71bc32-bc38-4de0-90d7-aa3df05ce0de tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:21.684540 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ca71bc32-bc38-4de0-90d7-aa3df05ce0de tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:21.698793 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ca71bc32-bc38-4de0-90d7-aa3df05ce0de tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.173272 May 16 18:54:21.699536 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 350/709] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:21 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:21.974162 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-aa4161c7-a2ed-48ff-abaa-a4aaf9efa3c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:21.974758 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-aa4161c7-a2ed-48ff-abaa-a4aaf9efa3c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:21.982342 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa4161c7-a2ed-48ff-abaa-a4aaf9efa3c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:21.982793 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa4161c7-a2ed-48ff-abaa-a4aaf9efa3c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:21.983928 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa4161c7-a2ed-48ff-abaa-a4aaf9efa3c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:21.984373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa4161c7-a2ed-48ff-abaa-a4aaf9efa3c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:22.140572 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-aa4161c7-a2ed-48ff-abaa-a4aaf9efa3c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:22.148768 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-aa4161c7-a2ed-48ff-abaa-a4aaf9efa3c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1671 microversion: 2.1 time: 0.178402 May 16 18:54:22.149406 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 360/710] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:21 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1671 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:22.719637 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-aeff18d0-c545-4956-aa91-acca5e82fdfd tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:22.720544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-aeff18d0-c545-4956-aa91-acca5e82fdfd tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:22.726914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aeff18d0-c545-4956-aa91-acca5e82fdfd tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:22.727908 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aeff18d0-c545-4956-aa91-acca5e82fdfd tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:22.729322 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aeff18d0-c545-4956-aa91-acca5e82fdfd tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:22.729769 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aeff18d0-c545-4956-aa91-acca5e82fdfd tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:22.901947 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-aeff18d0-c545-4956-aa91-acca5e82fdfd tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:22.910064 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-aeff18d0-c545-4956-aa91-acca5e82fdfd tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.194597 May 16 18:54:22.910656 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 351/711] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:22 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:23.170061 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f6d4abb0-b5e6-4d61-8a88-5e7a0ce3c074 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:23.171147 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f6d4abb0-b5e6-4d61-8a88-5e7a0ce3c074 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:23.179023 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f6d4abb0-b5e6-4d61-8a88-5e7a0ce3c074 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:23.179568 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f6d4abb0-b5e6-4d61-8a88-5e7a0ce3c074 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:23.180477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f6d4abb0-b5e6-4d61-8a88-5e7a0ce3c074 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:23.180915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f6d4abb0-b5e6-4d61-8a88-5e7a0ce3c074 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:23.354653 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f6d4abb0-b5e6-4d61-8a88-5e7a0ce3c074 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:23.367908 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f6d4abb0-b5e6-4d61-8a88-5e7a0ce3c074 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1671 microversion: 2.1 time: 0.204218 May 16 18:54:23.369239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 361/712] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:23 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1671 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:23.928248 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-35691ba9-63b3-4736-b863-1e45a7057f75 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:23.928893 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-35691ba9-63b3-4736-b863-1e45a7057f75 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:23.935833 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35691ba9-63b3-4736-b863-1e45a7057f75 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:23.936295 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35691ba9-63b3-4736-b863-1e45a7057f75 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:23.937076 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35691ba9-63b3-4736-b863-1e45a7057f75 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:23.937519 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35691ba9-63b3-4736-b863-1e45a7057f75 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:24.089130 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-e92b26e5-4bfe-4df9-81c9-9d0d05116ad2 req-64dec0cc-0035-4307-a26d-b0e4d21b40c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5e49a3-f392-4cd6-9856-4b5367c2d5e2", "name": "network-vif-deleted", "tag": "b440849e-31ba-4612-a125-9eec9ce576a6"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:24.115495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-e92b26e5-4bfe-4df9-81c9-9d0d05116ad2 req-64dec0cc-0035-4307-a26d-b0e4d21b40c8 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:24.115984 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-e92b26e5-4bfe-4df9-81c9-9d0d05116ad2 req-64dec0cc-0035-4307-a26d-b0e4d21b40c8 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:24.147483 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-e92b26e5-4bfe-4df9-81c9-9d0d05116ad2 req-64dec0cc-0035-4307-a26d-b0e4d21b40c8 service nova] Creating event network-vif-deleted:b440849e-31ba-4612-a125-9eec9ce576a6 for instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 on hv-cinder-75078 May 16 18:54:24.162739 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-35691ba9-63b3-4736-b863-1e45a7057f75 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:24.164686 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-e92b26e5-4bfe-4df9-81c9-9d0d05116ad2 req-64dec0cc-0035-4307-a26d-b0e4d21b40c8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205693 May 16 18:54:24.166023 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 362/713] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:24.183703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-35691ba9-63b3-4736-b863-1e45a7057f75 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.258713 May 16 18:54:24.195666 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 352/714] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:23 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:24.389514 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:24.390231 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:24.401560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:24.402373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:24.403283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:24.403827 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:24.448937 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:24.449391 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:24.449856 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lazy-loading 'fault' on Instance uuid bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:54:24.514503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:24.531531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-073fafbe-1496-4201-a502-fcce3aec425d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 200 len: 1326 microversion: 2.1 time: 0.148457 May 16 18:54:24.533652 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 363/715] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:24 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 1326 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:25.210794 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-da97b655-5bcb-43af-9899-c5a688fabebe tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:25.211440 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-da97b655-5bcb-43af-9899-c5a688fabebe tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:25.220360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da97b655-5bcb-43af-9899-c5a688fabebe tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:25.220816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da97b655-5bcb-43af-9899-c5a688fabebe tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:25.221602 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da97b655-5bcb-43af-9899-c5a688fabebe tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:25.222035 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da97b655-5bcb-43af-9899-c5a688fabebe tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:25.397749 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-da97b655-5bcb-43af-9899-c5a688fabebe tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:25.406205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-da97b655-5bcb-43af-9899-c5a688fabebe tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.199479 May 16 18:54:25.406838 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 353/716] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:25 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:25.555661 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a3e01260-c49c-48e2-a649-a7523341dacc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:25.556861 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a3e01260-c49c-48e2-a649-a7523341dacc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:25.566890 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a3e01260-c49c-48e2-a649-a7523341dacc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:25.567688 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a3e01260-c49c-48e2-a649-a7523341dacc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:25.569168 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a3e01260-c49c-48e2-a649-a7523341dacc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:25.569954 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a3e01260-c49c-48e2-a649-a7523341dacc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:25.592601 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-a3e01260-c49c-48e2-a649-a7523341dacc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] HTTP exception thrown: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a3e01260-c49c-48e2-a649-a7523341dacc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Request method failure captured: May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 HTTP/1.1 May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyNik-rBQNygEkPA8ejxpR78IavGzTPEzAL8TaxfAsdBa4-LFUgZeeUnXRBxE5HNtDKbcg_P2LHSqzLVS74-YiQFXdtrxtuHuelTaeRpiEr5qaCLfpSfQzNpwtdEmlV8-Esiozgpp_13vkx54wlvxTN2to1PLT5Mz3UEIIi8PcCxUE May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:54:25.594517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeTestJSON-1298286979 May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: dab7aa55b2554d338cd76f34d03e1ef2 May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:54:25.597233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'bd5e49a3-f392-4cd6-9856-4b5367c2d5e2'} May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:54:25.598283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:54:25.599891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:25.601322 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a3e01260-c49c-48e2-a649-a7523341dacc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Returning 404 to user: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:54:25.601322 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a3e01260-c49c-48e2-a649-a7523341dacc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 404 len: 111 microversion: 2.1 time: 0.047434 May 16 18:54:25.601322 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 364/717] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:25 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:54:25.606710 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4d166917-3980-429e-9d03-2e679145100a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '.version_select at 0x7f646850d790>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:25.626079 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4d166917-3980-429e-9d03-2e679145100a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-515346986" status: 202 len: 0 microversion: 2.1 time: 0.023180 May 16 18:54:25.626661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 354/718] 10.222.0.72 () {58 vars in 1217 bytes} [Mon May 16 18:54:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-515346986 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:54:26.312456 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-550f264f-475b-483e-86b8-a4d310bcf50f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'create', calling method: .version_select at 0x7f646cf2fee0>, body: {"keypair": {"name": "tempest-keypair-180807774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx3gEsES6iBvmtoSyEfg5aX4Fn6L/euVdpy3rBwSBATAPbiaZ3P1WrwQ5co6S9SehXW1A6MaVl6V70iXui5gVHPG1xsART0UjC82MaVbJ/i8ulpeGWIGIDB7isSDBZkQQ=="}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:26.329442 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-550f264f-475b-483e-86b8-a4d310bcf50f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Getting quotas for project 75d882994e2c443fb1d9104ccbfb8c7f. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:54:26.333255 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-550f264f-475b-483e-86b8-a4d310bcf50f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Getting quotas for user dab7aa55b2554d338cd76f34d03e1ef2 and project 75d882994e2c443fb1d9104ccbfb8c7f. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:54:26.357393 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-550f264f-475b-483e-86b8-a4d310bcf50f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050001 May 16 18:54:26.358007 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 365/719] 10.222.0.72 () {60 vars in 1158 bytes} [Mon May 16 18:54:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:26.426639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6cd38b17-c2c7-447d-9679-64b3a9b1f073 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:26.427534 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6cd38b17-c2c7-447d-9679-64b3a9b1f073 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:26.434653 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6cd38b17-c2c7-447d-9679-64b3a9b1f073 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:26.435200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6cd38b17-c2c7-447d-9679-64b3a9b1f073 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:26.436099 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6cd38b17-c2c7-447d-9679-64b3a9b1f073 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:26.436613 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6cd38b17-c2c7-447d-9679-64b3a9b1f073 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:26.626160 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6cd38b17-c2c7-447d-9679-64b3a9b1f073 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:26.638569 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6cd38b17-c2c7-447d-9679-64b3a9b1f073 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.216458 May 16 18:54:26.639434 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 355/720] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:26 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:26.685303 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-28e220fa-32ae-4ae6-b432-ef89d25fed8b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06bf90e5-56b2-45f9-856c-339f30af8c35"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:26.686454 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-28e220fa-32ae-4ae6-b432-ef89d25fed8b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:26.695218 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-28e220fa-32ae-4ae6-b432-ef89d25fed8b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:26.695778 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-28e220fa-32ae-4ae6-b432-ef89d25fed8b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:26.696758 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-28e220fa-32ae-4ae6-b432-ef89d25fed8b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:26.697221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-28e220fa-32ae-4ae6-b432-ef89d25fed8b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:26.803146 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-28e220fa-32ae-4ae6-b432-ef89d25fed8b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Invalid volume: volume 06bf90e5-56b2-45f9-856c-339f30af8c35 is already attached to instances: bce01de2-ca20-437e-93cb-975e3add0542 May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-28e220fa-32ae-4ae6-b432-ef89d25fed8b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: POST /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments HTTP/1.1 May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 74 May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:54:26.805812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {"volumeAttachment": {"volumeId": "06bf90e5-56b2-45f9-856c-339f30af8c35"}} May 16 18:54:26.808120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Invalid volume: volume 06bf90e5-56b2-45f9-856c-339f30af8c35 is already attached to instances: bce01de2-ca20-437e-93cb-975e3add0542 May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'server_id': 'bce01de2-ca20-437e-93cb-975e3add0542', 'body': {'volumeAttachment': {'volumeId': '06bf90e5-56b2-45f9-856c-339f30af8c35'}}} May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 06bf90e5-56b2-45f9-856c-339f30af8c35 is already attached to instances: bce01de2-ca20-437e-93cb-975e3add0542 May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:26.809346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 06bf90e5-56b2-45f9-856c-339f30af8c35 is already attached to instances: bce01de2-ca20-437e-93cb-975e3add0542 May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:26.812296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:54:26.814067 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:54:26.814067 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:54:26.814067 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:54:26.814067 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 06bf90e5-56b2-45f9-856c-339f30af8c35 is already attached to instances: bce01de2-ca20-437e-93cb-975e3add0542 May 16 18:54:26.814067 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:26.815337 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-28e220fa-32ae-4ae6-b432-ef89d25fed8b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 400 to user: Invalid volume: volume 06bf90e5-56b2-45f9-856c-339f30af8c35 is already attached to instances: bce01de2-ca20-437e-93cb-975e3add0542 {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:54:26.816851 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-28e220fa-32ae-4ae6-b432-ef89d25fed8b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.136490 May 16 18:54:26.817529 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 366/721] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:54:26 2022] POST /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments => generated 174 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 18:54:26.907333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b0184af0-b5c0-40d6-813b-cc6ad0a1b238 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:26.908592 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b0184af0-b5c0-40d6-813b-cc6ad0a1b238 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:26.920240 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b0184af0-b5c0-40d6-813b-cc6ad0a1b238 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:26.920890 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b0184af0-b5c0-40d6-813b-cc6ad0a1b238 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:26.921805 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b0184af0-b5c0-40d6-813b-cc6ad0a1b238 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:26.922342 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b0184af0-b5c0-40d6-813b-cc6ad0a1b238 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:27.028104 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-b0184af0-b5c0-40d6-813b-cc6ad0a1b238 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lazy-loading 'services' on Instance uuid bce01de2-ca20-437e-93cb-975e3add0542 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:54:27.114850 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b0184af0-b5c0-40d6-813b-cc6ad0a1b238 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments/06bf90e5-56b2-45f9-856c-339f30af8c35" status: 202 len: 0 microversion: 2.1 time: 0.214906 May 16 18:54:27.115626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 356/722] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 18:54:26 2022] DELETE /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments/06bf90e5-56b2-45f9-856c-339f30af8c35 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:54:27.129181 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c931c14e-36c1-40a7-8112-d02170df698d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:27.130382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c931c14e-36c1-40a7-8112-d02170df698d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:27.137492 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c931c14e-36c1-40a7-8112-d02170df698d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:27.138183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c931c14e-36c1-40a7-8112-d02170df698d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:27.139353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c931c14e-36c1-40a7-8112-d02170df698d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:27.139914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c931c14e-36c1-40a7-8112-d02170df698d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:27.182235 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c931c14e-36c1-40a7-8112-d02170df698d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060326 May 16 18:54:27.183337 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 367/723] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:54:27 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:27.666553 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-363366c4-2ce7-453d-9294-be6402d0fd12 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:27.667657 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-363366c4-2ce7-453d-9294-be6402d0fd12 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:27.678187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-363366c4-2ce7-453d-9294-be6402d0fd12 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:27.679025 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-363366c4-2ce7-453d-9294-be6402d0fd12 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:27.680476 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-363366c4-2ce7-453d-9294-be6402d0fd12 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:27.681261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-363366c4-2ce7-453d-9294-be6402d0fd12 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:27.869221 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-363366c4-2ce7-453d-9294-be6402d0fd12 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:27.881859 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-363366c4-2ce7-453d-9294-be6402d0fd12 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.223331 May 16 18:54:27.882951 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 357/724] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:27 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:27.969690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1947761075", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "265ca952-32c3-45ee-8297-5b81b68af9fb"}], "security_groups": [{"name": "tempest-securitygroup--398731502"}], "key_name": "tempest-keypair-180807774", "user_data": "}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:28.096677 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.network.neutron [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] validate_networks() for [('265ca952-32c3-45ee-8297-5b81b68af9fb', None, None, None, None, None)] {{(pid=128886) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:54:28.193936 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2464cf0d-a8e3-4d82-9887-d39e9af8c11b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:28.195027 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2464cf0d-a8e3-4d82-9887-d39e9af8c11b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:28.204323 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2464cf0d-a8e3-4d82-9887-d39e9af8c11b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:28.205351 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2464cf0d-a8e3-4d82-9887-d39e9af8c11b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:28.216593 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2464cf0d-a8e3-4d82-9887-d39e9af8c11b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:28.217604 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2464cf0d-a8e3-4d82-9887-d39e9af8c11b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:28.260615 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2464cf0d-a8e3-4d82-9887-d39e9af8c11b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070773 May 16 18:54:28.261478 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 358/725] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:54:28 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 18:54:28.345317 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0e3f50e5-e8eb-49c6-94c9-2536bcb69ecf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:28.345816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0e3f50e5-e8eb-49c6-94c9-2536bcb69ecf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:28.354397 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0e3f50e5-e8eb-49c6-94c9-2536bcb69ecf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:28.355047 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0e3f50e5-e8eb-49c6-94c9-2536bcb69ecf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:28.356208 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0e3f50e5-e8eb-49c6-94c9-2536bcb69ecf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:28.357127 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0e3f50e5-e8eb-49c6-94c9-2536bcb69ecf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:28.397059 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0e3f50e5-e8eb-49c6-94c9-2536bcb69ecf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:54:28.501730 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0e3f50e5-e8eb-49c6-94c9-2536bcb69ecf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 204 len: 0 microversion: 2.1 time: 0.161768 May 16 18:54:28.502210 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 359/726] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:54:28 2022] DELETE /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 18:54:28.517919 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-22e230ca-66f0-40fb-a2cd-8088afff82a7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:28.518640 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-22e230ca-66f0-40fb-a2cd-8088afff82a7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:28.526138 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-22e230ca-66f0-40fb-a2cd-8088afff82a7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:28.526595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-22e230ca-66f0-40fb-a2cd-8088afff82a7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:28.527420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-22e230ca-66f0-40fb-a2cd-8088afff82a7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:28.527963 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-22e230ca-66f0-40fb-a2cd-8088afff82a7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:28.692497 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Flavor limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:54:28.693077 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Image limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:54:28.693633 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Flavor pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:54:28.694155 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Image pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:54:28.694639 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:54:28.705112 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:28.705660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:28.706533 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:28.707039 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:28.726589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Getting quotas for project 75d882994e2c443fb1d9104ccbfb8c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:54:28.731139 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Getting quotas for user dab7aa55b2554d338cd76f34d03e1ef2 and project 75d882994e2c443fb1d9104ccbfb8c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:54:28.737154 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-22e230ca-66f0-40fb-a2cd-8088afff82a7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:28.748046 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-22e230ca-66f0-40fb-a2cd-8088afff82a7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1682 microversion: 2.1 time: 0.235305 May 16 18:54:28.748748 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 360/727] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:28 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1682 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:28.753686 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Going to run 1 instances... {{(pid=128886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:54:28.755939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:54:28.817258 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-be10db27-cdea-4bb7-8d68-0111b7ca28c7 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.851883 May 16 18:54:28.818126 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 368/728] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:54:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 18:54:28.828723 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-36e20220-87d5-4be5-9998-050774aa6f7f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:28.829313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-36e20220-87d5-4be5-9998-050774aa6f7f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:28.889883 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-36e20220-87d5-4be5-9998-050774aa6f7f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:28.901344 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-36e20220-87d5-4be5-9998-050774aa6f7f tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1237 microversion: 2.1 time: 0.076258 May 16 18:54:28.907800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 361/729] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:28 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:28.911096 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-859ddbb2-5308-4efc-98b0-bf4c9da3982f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:28.911754 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-859ddbb2-5308-4efc-98b0-bf4c9da3982f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:28.922374 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-859ddbb2-5308-4efc-98b0-bf4c9da3982f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:28.922836 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-859ddbb2-5308-4efc-98b0-bf4c9da3982f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:28.923671 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-859ddbb2-5308-4efc-98b0-bf4c9da3982f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:28.924171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-859ddbb2-5308-4efc-98b0-bf4c9da3982f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:29.124555 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-859ddbb2-5308-4efc-98b0-bf4c9da3982f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:29.132460 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-859ddbb2-5308-4efc-98b0-bf4c9da3982f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.227685 May 16 18:54:29.133057 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 369/730] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:28 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:29.770651 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b21c7973-8c55-49e5-954f-c537f66e386a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:29.771316 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b21c7973-8c55-49e5-954f-c537f66e386a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:29.780702 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b21c7973-8c55-49e5-954f-c537f66e386a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:29.781170 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b21c7973-8c55-49e5-954f-c537f66e386a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:29.781939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b21c7973-8c55-49e5-954f-c537f66e386a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:29.782371 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b21c7973-8c55-49e5-954f-c537f66e386a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:29.927114 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b21c7973-8c55-49e5-954f-c537f66e386a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:29.928443 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9c43e87e-0238-4233-b942-128441eeb91e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:29.929060 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9c43e87e-0238-4233-b942-128441eeb91e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:29.936549 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b21c7973-8c55-49e5-954f-c537f66e386a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1682 microversion: 2.1 time: 0.169474 May 16 18:54:29.937042 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 362/731] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:29 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:29.939173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c43e87e-0238-4233-b942-128441eeb91e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:29.940050 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c43e87e-0238-4233-b942-128441eeb91e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:29.941435 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c43e87e-0238-4233-b942-128441eeb91e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:29.942312 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c43e87e-0238-4233-b942-128441eeb91e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:30.023468 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9c43e87e-0238-4233-b942-128441eeb91e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:30.032328 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9c43e87e-0238-4233-b942-128441eeb91e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1241 microversion: 2.1 time: 0.107746 May 16 18:54:30.032922 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 370/732] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:29 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:30.152773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8a830e22-7f62-4178-b545-25a7ee7f6941 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:30.153425 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8a830e22-7f62-4178-b545-25a7ee7f6941 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:30.159912 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a830e22-7f62-4178-b545-25a7ee7f6941 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:30.160358 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a830e22-7f62-4178-b545-25a7ee7f6941 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:30.161156 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a830e22-7f62-4178-b545-25a7ee7f6941 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:30.161593 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8a830e22-7f62-4178-b545-25a7ee7f6941 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:30.321712 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8a830e22-7f62-4178-b545-25a7ee7f6941 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:30.330806 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8a830e22-7f62-4178-b545-25a7ee7f6941 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.182729 May 16 18:54:30.331422 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 363/733] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:30 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:30.960478 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2a256cee-02df-4fd9-a3eb-a5ea568f06cf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:30.961154 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2a256cee-02df-4fd9-a3eb-a5ea568f06cf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:30.967572 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2a256cee-02df-4fd9-a3eb-a5ea568f06cf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:30.968028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2a256cee-02df-4fd9-a3eb-a5ea568f06cf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:30.968832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2a256cee-02df-4fd9-a3eb-a5ea568f06cf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:30.969312 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2a256cee-02df-4fd9-a3eb-a5ea568f06cf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:31.053839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-eeb2b4b7-ca05-4fd9-8aa7-fb7503d300b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:31.054575 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-eeb2b4b7-ca05-4fd9-8aa7-fb7503d300b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:31.064124 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eeb2b4b7-ca05-4fd9-8aa7-fb7503d300b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:31.064331 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eeb2b4b7-ca05-4fd9-8aa7-fb7503d300b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:31.068654 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eeb2b4b7-ca05-4fd9-8aa7-fb7503d300b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:31.069190 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eeb2b4b7-ca05-4fd9-8aa7-fb7503d300b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:31.191989 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-eeb2b4b7-ca05-4fd9-8aa7-fb7503d300b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:31.209905 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2a256cee-02df-4fd9-a3eb-a5ea568f06cf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:31.211203 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-eeb2b4b7-ca05-4fd9-8aa7-fb7503d300b5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1289 microversion: 2.1 time: 0.165200 May 16 18:54:31.221988 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 364/734] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:31 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1289 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:31.249201 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2a256cee-02df-4fd9-a3eb-a5ea568f06cf tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1682 microversion: 2.1 time: 0.292525 May 16 18:54:31.249901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 371/735] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:30 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1682 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:31.353147 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-aedab120-d5da-4285-a7c0-5dcf43a509c8 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:31.354367 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-aedab120-d5da-4285-a7c0-5dcf43a509c8 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:31.370264 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aedab120-d5da-4285-a7c0-5dcf43a509c8 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:31.371482 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aedab120-d5da-4285-a7c0-5dcf43a509c8 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:31.372696 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aedab120-d5da-4285-a7c0-5dcf43a509c8 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:31.373725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aedab120-d5da-4285-a7c0-5dcf43a509c8 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:31.619091 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-aedab120-d5da-4285-a7c0-5dcf43a509c8 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:31.627965 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-aedab120-d5da-4285-a7c0-5dcf43a509c8 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.282320 May 16 18:54:31.638605 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 365/736] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:31 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:31.989580 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-f76efb1e-ab60-465d-9002-045ffb137f8d req-96cf661f-e029-40cc-9918-067696f0850f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce01de2-ca20-437e-93cb-975e3add0542", "name": "network-vif-deleted", "tag": "7c0dd6ff-ef1c-4ed0-809d-6f90671e139b"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:32.013943 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-f76efb1e-ab60-465d-9002-045ffb137f8d req-96cf661f-e029-40cc-9918-067696f0850f service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:32.016692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-f76efb1e-ab60-465d-9002-045ffb137f8d req-96cf661f-e029-40cc-9918-067696f0850f service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:32.044950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-f76efb1e-ab60-465d-9002-045ffb137f8d req-96cf661f-e029-40cc-9918-067696f0850f service nova] Creating event network-vif-deleted:7c0dd6ff-ef1c-4ed0-809d-6f90671e139b for instance bce01de2-ca20-437e-93cb-975e3add0542 on hv-cinder-75078 May 16 18:54:32.051078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-f76efb1e-ab60-465d-9002-045ffb137f8d req-96cf661f-e029-40cc-9918-067696f0850f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065194 May 16 18:54:32.052462 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 372/737] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:54:32.232541 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-760a1136-cf6c-4af3-aafa-feda7874c765 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:32.233926 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-760a1136-cf6c-4af3-aafa-feda7874c765 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:32.241715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-760a1136-cf6c-4af3-aafa-feda7874c765 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:32.242571 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-760a1136-cf6c-4af3-aafa-feda7874c765 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:32.244529 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-760a1136-cf6c-4af3-aafa-feda7874c765 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:32.245211 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-760a1136-cf6c-4af3-aafa-feda7874c765 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:32.272208 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:32.272930 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:32.283172 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:32.283963 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:32.285207 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:32.285944 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:32.350654 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:32.351525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:32.352438 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lazy-loading 'fault' on Instance uuid bce01de2-ca20-437e-93cb-975e3add0542 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:54:32.448287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:32.461815 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-097bfce9-0d07-40ed-be74-5f58bd93c5b7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 200 len: 1331 microversion: 2.1 time: 0.197562 May 16 18:54:32.468759 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-760a1136-cf6c-4af3-aafa-feda7874c765 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:32.475344 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 373/738] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:32 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 1331 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:32.480414 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-760a1136-cf6c-4af3-aafa-feda7874c765 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1362 microversion: 2.1 time: 0.253176 May 16 18:54:32.481020 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 366/739] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:32 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:32.647686 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bcaf28ef-d6ff-48cb-a6ac-3650d7385826 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:32.648790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-bcaf28ef-d6ff-48cb-a6ac-3650d7385826 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:32.658559 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bcaf28ef-d6ff-48cb-a6ac-3650d7385826 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:32.659361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bcaf28ef-d6ff-48cb-a6ac-3650d7385826 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:32.660938 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bcaf28ef-d6ff-48cb-a6ac-3650d7385826 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:32.662341 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bcaf28ef-d6ff-48cb-a6ac-3650d7385826 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:32.946842 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bcaf28ef-d6ff-48cb-a6ac-3650d7385826 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:32.957154 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-bcaf28ef-d6ff-48cb-a6ac-3650d7385826 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.313928 May 16 18:54:32.958024 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 374/740] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:32 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:33.491317 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-209180eb-5d58-4b8a-810a-014b6e2d49e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:33.496826 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-209180eb-5d58-4b8a-810a-014b6e2d49e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:33.532605 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-209180eb-5d58-4b8a-810a-014b6e2d49e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:33.533048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-209180eb-5d58-4b8a-810a-014b6e2d49e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:33.534055 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-209180eb-5d58-4b8a-810a-014b6e2d49e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:33.534696 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-209180eb-5d58-4b8a-810a-014b6e2d49e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:33.559652 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-209180eb-5d58-4b8a-810a-014b6e2d49e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-209180eb-5d58-4b8a-810a-014b6e2d49e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 HTTP/1.1 May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:54:33.562260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:54:33.565131 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'bce01de2-ca20-437e-93cb-975e3add0542'} May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:54:33.566474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:54:33.569852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:54:33.574635 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-209180eb-5d58-4b8a-810a-014b6e2d49e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:54:33.574635 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-209180eb-5d58-4b8a-810a-014b6e2d49e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 404 len: 111 microversion: 2.1 time: 0.079968 May 16 18:54:33.574635 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 375/741] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:33 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:54:33.574635 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-769d72d4-7316-476c-ae6b-333d11967a71 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:33.574635 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-769d72d4-7316-476c-ae6b-333d11967a71 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:33.580492 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-769d72d4-7316-476c-ae6b-333d11967a71 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:33.581033 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-769d72d4-7316-476c-ae6b-333d11967a71 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:33.582206 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-769d72d4-7316-476c-ae6b-333d11967a71 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:33.582717 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-769d72d4-7316-476c-ae6b-333d11967a71 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:33.646828 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-71cabc96-8175-44f6-845a-6bb4b079db01 req-e6f39d15-ef9b-45e9-9860-a1b51274aa23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c93bb74-3b57-4277-9a6b-e8b7569f301d", "tag": "2c309251-7e9b-443c-b897-9cf5b018f4b9"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:33.682290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-71cabc96-8175-44f6-845a-6bb4b079db01 req-e6f39d15-ef9b-45e9-9860-a1b51274aa23 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:33.683069 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-71cabc96-8175-44f6-845a-6bb4b079db01 req-e6f39d15-ef9b-45e9-9860-a1b51274aa23 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:33.714891 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-71cabc96-8175-44f6-845a-6bb4b079db01 req-e6f39d15-ef9b-45e9-9860-a1b51274aa23 service nova] Creating event network-changed:2c309251-7e9b-443c-b897-9cf5b018f4b9 for instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d on hv-cinder-75078 May 16 18:54:33.730252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-71cabc96-8175-44f6-845a-6bb4b079db01 req-e6f39d15-ef9b-45e9-9860-a1b51274aa23 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267310 May 16 18:54:33.738407 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 367/742] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:33.753606 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c2621d34-cee2-42ad-9b3f-2b75b977577d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '.version_select at 0x7f6468536550>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:33.789502 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c2621d34-cee2-42ad-9b3f-2b75b977577d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-368513386" status: 202 len: 0 microversion: 2.1 time: 0.048764 May 16 18:54:33.790929 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 368/743] 10.222.0.72 () {58 vars in 1217 bytes} [Mon May 16 18:54:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-368513386 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:54:33.898105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-769d72d4-7316-476c-ae6b-333d11967a71 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:33.913087 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-769d72d4-7316-476c-ae6b-333d11967a71 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1362 microversion: 2.1 time: 0.346739 May 16 18:54:33.914951 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 376/744] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:33 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:33.974871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-312a8d45-87e3-4096-b9cd-8bddd3df31f7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:33.976017 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-312a8d45-87e3-4096-b9cd-8bddd3df31f7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:33.983433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-312a8d45-87e3-4096-b9cd-8bddd3df31f7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:33.984143 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-312a8d45-87e3-4096-b9cd-8bddd3df31f7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:33.985288 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-312a8d45-87e3-4096-b9cd-8bddd3df31f7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:33.985986 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-312a8d45-87e3-4096-b9cd-8bddd3df31f7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:34.193408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-312a8d45-87e3-4096-b9cd-8bddd3df31f7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:34.203371 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-312a8d45-87e3-4096-b9cd-8bddd3df31f7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.232615 May 16 18:54:34.204287 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 369/745] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:33 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:34.641340 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-efee89d7-9417-4413-b2c1-43c487fca50b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: .version_select at 0x7f646cf70310>, body: {"keypair": {"name": "tempest-keypair-930976190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuegRLxAr+DVZpqpcp+5fBHIuLcmVb8CiUftUQ/+V6spzdrPiEAe1lOsFHgtJSsGfGVHfPwws881oZ3Qn95Y0+JHzHUA6EPevtVcKATQ0hU9bctx07BE2y3hZNCEIr+Mg=="}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:34.656173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-efee89d7-9417-4413-b2c1-43c487fca50b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:54:34.660162 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-efee89d7-9417-4413-b2c1-43c487fca50b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for user cd0d8acbe24d410690470e3d9d4882b1 and project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'key_pairs'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:54:34.690914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-efee89d7-9417-4413-b2c1-43c487fca50b tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053612 May 16 18:54:34.691525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 377/746] 10.222.0.72 () {60 vars in 1158 bytes} [Mon May 16 18:54:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:34.937771 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4d169d14-ebd0-4bfc-9c11-1f58b9c84f94 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:34.939279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4d169d14-ebd0-4bfc-9c11-1f58b9c84f94 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:34.948394 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4d169d14-ebd0-4bfc-9c11-1f58b9c84f94 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:34.948952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4d169d14-ebd0-4bfc-9c11-1f58b9c84f94 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:34.949876 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4d169d14-ebd0-4bfc-9c11-1f58b9c84f94 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:34.950742 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4d169d14-ebd0-4bfc-9c11-1f58b9c84f94 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:35.130442 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4d169d14-ebd0-4bfc-9c11-1f58b9c84f94 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:35.142500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4d169d14-ebd0-4bfc-9c11-1f58b9c84f94 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1362 microversion: 2.1 time: 0.210963 May 16 18:54:35.143392 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 370/747] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:34 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:35.225520 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6a43a37e-5849-4897-acd2-8e02add543bb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:35.226377 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6a43a37e-5849-4897-acd2-8e02add543bb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:35.235888 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6a43a37e-5849-4897-acd2-8e02add543bb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:35.236646 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6a43a37e-5849-4897-acd2-8e02add543bb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:35.237979 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6a43a37e-5849-4897-acd2-8e02add543bb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:35.238729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6a43a37e-5849-4897-acd2-8e02add543bb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:35.469077 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6a43a37e-5849-4897-acd2-8e02add543bb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:35.480518 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6a43a37e-5849-4897-acd2-8e02add543bb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.260201 May 16 18:54:35.496970 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 378/748] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:35 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:36.161496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ea735b67-5a8f-40d5-aca1-b02ad09a9b02 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:36.162276 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ea735b67-5a8f-40d5-aca1-b02ad09a9b02 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:36.171257 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ea735b67-5a8f-40d5-aca1-b02ad09a9b02 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:36.172162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ea735b67-5a8f-40d5-aca1-b02ad09a9b02 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:36.173162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ea735b67-5a8f-40d5-aca1-b02ad09a9b02 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:36.173871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ea735b67-5a8f-40d5-aca1-b02ad09a9b02 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:36.410101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ea735b67-5a8f-40d5-aca1-b02ad09a9b02 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:36.419023 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ea735b67-5a8f-40d5-aca1-b02ad09a9b02 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1362 microversion: 2.1 time: 0.261400 May 16 18:54:36.419625 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 371/749] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:36 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:36.505310 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-29dd4ae4-9655-447a-89c3-b4a4bfc43ec3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:36.505992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-29dd4ae4-9655-447a-89c3-b4a4bfc43ec3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:36.514728 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-29dd4ae4-9655-447a-89c3-b4a4bfc43ec3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:36.515478 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-29dd4ae4-9655-447a-89c3-b4a4bfc43ec3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:36.516788 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-29dd4ae4-9655-447a-89c3-b4a4bfc43ec3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:36.517333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-29dd4ae4-9655-447a-89c3-b4a4bfc43ec3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:36.734012 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-29dd4ae4-9655-447a-89c3-b4a4bfc43ec3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:36.742971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-29dd4ae4-9655-447a-89c3-b4a4bfc43ec3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.242243 May 16 18:54:36.743750 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 379/750] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:36 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:36.745409 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-894044852", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "236a317a-f889-44df-b53d-ac5f81a24b24"}], "security_groups": [{"name": "tempest-securitygroup--1628198401"}], "key_name": "tempest-keypair-930976190", "user_data": "}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:36.860767 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] validate_networks() for [('236a317a-f889-44df-b53d-ac5f81a24b24', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:54:37.427046 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:54:37.428042 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:54:37.429851 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:54:37.429851 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:54:37.430086 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:54:37.439742 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3120bf16-b93d-4779-8c88-f7fdc9ee14c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:37.440548 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3120bf16-b93d-4779-8c88-f7fdc9ee14c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:37.441340 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:37.441790 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:37.442609 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:37.443069 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:37.447459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3120bf16-b93d-4779-8c88-f7fdc9ee14c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:37.448042 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3120bf16-b93d-4779-8c88-f7fdc9ee14c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:37.448908 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3120bf16-b93d-4779-8c88-f7fdc9ee14c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:37.449385 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3120bf16-b93d-4779-8c88-f7fdc9ee14c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:37.464825 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:54:37.470459 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Getting quotas for user cd0d8acbe24d410690470e3d9d4882b1 and project 593c7b69cbad453499aacad0ad6e64ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:54:37.486725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:54:37.489543 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:54:37.552012 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e7752f45-dfe4-4c68-a844-d6ae2ca4ed93 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.810807 May 16 18:54:37.552654 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 372/751] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:54:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 18:54:37.564182 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9e26faf9-5f52-495e-b485-e0d07a913bd7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:37.565047 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9e26faf9-5f52-495e-b485-e0d07a913bd7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:37.681374 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9e26faf9-5f52-495e-b485-e0d07a913bd7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:37.692783 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9e26faf9-5f52-495e-b485-e0d07a913bd7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1240 microversion: 2.1 time: 0.132665 May 16 18:54:37.699095 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3120bf16-b93d-4779-8c88-f7fdc9ee14c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:37.704885 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 373/752] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:37 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1240 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:37.712473 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3120bf16-b93d-4779-8c88-f7fdc9ee14c5 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1362 microversion: 2.1 time: 0.276595 May 16 18:54:37.714266 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 380/753] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:37 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:37.765199 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8909e949-43dd-4742-ba81-db98189e539c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:37.766102 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8909e949-43dd-4742-ba81-db98189e539c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:37.773048 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8909e949-43dd-4742-ba81-db98189e539c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:37.773487 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8909e949-43dd-4742-ba81-db98189e539c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:37.774875 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8909e949-43dd-4742-ba81-db98189e539c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:37.775310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8909e949-43dd-4742-ba81-db98189e539c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:38.032891 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8909e949-43dd-4742-ba81-db98189e539c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:38.041499 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8909e949-43dd-4742-ba81-db98189e539c tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1511 microversion: 2.1 time: 0.280049 May 16 18:54:38.053847 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 374/754] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:37 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:38.061427 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1390ac2a-a157-4c90-8f50-d0cd02549fc2 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:38.062278 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1390ac2a-a157-4c90-8f50-d0cd02549fc2 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:38.072270 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1390ac2a-a157-4c90-8f50-d0cd02549fc2 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:38.073077 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1390ac2a-a157-4c90-8f50-d0cd02549fc2 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:38.073961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1390ac2a-a157-4c90-8f50-d0cd02549fc2 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:38.074427 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1390ac2a-a157-4c90-8f50-d0cd02549fc2 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:38.195283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1390ac2a-a157-4c90-8f50-d0cd02549fc2 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "POST /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5/action" status: 202 len: 0 microversion: 2.1 time: 0.138073 May 16 18:54:38.199111 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 381/755] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:54:38 2022] POST /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:54:38.208928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d292838b-4215-4ee7-8368-f6c7919c52b7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:38.209708 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d292838b-4215-4ee7-8368-f6c7919c52b7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:38.220768 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d292838b-4215-4ee7-8368-f6c7919c52b7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:38.221417 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d292838b-4215-4ee7-8368-f6c7919c52b7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:38.222684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d292838b-4215-4ee7-8368-f6c7919c52b7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:38.223330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d292838b-4215-4ee7-8368-f6c7919c52b7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:38.463701 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d292838b-4215-4ee7-8368-f6c7919c52b7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:38.478228 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d292838b-4215-4ee7-8368-f6c7919c52b7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1519 microversion: 2.1 time: 0.276565 May 16 18:54:38.485049 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 375/756] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:38 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1519 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:38.721982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-028690e2-497e-4087-ae69-dac2e43b01a0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:38.723592 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-028690e2-497e-4087-ae69-dac2e43b01a0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:38.735695 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-35ff03ea-2335-4b96-8779-55a3da379478 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:38.736384 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-35ff03ea-2335-4b96-8779-55a3da379478 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:38.736668 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-028690e2-497e-4087-ae69-dac2e43b01a0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:38.737129 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-028690e2-497e-4087-ae69-dac2e43b01a0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:38.738060 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-028690e2-497e-4087-ae69-dac2e43b01a0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:38.738497 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-028690e2-497e-4087-ae69-dac2e43b01a0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:38.744883 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35ff03ea-2335-4b96-8779-55a3da379478 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:38.745593 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35ff03ea-2335-4b96-8779-55a3da379478 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:38.746554 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35ff03ea-2335-4b96-8779-55a3da379478 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:38.747305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35ff03ea-2335-4b96-8779-55a3da379478 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:38.871133 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-028690e2-497e-4087-ae69-dac2e43b01a0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:38.885715 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-028690e2-497e-4087-ae69-dac2e43b01a0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1292 microversion: 2.1 time: 0.168391 May 16 18:54:38.887132 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 382/757] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:38 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1292 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:39.085396 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-35ff03ea-2335-4b96-8779-55a3da379478 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:39.096222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-35ff03ea-2335-4b96-8779-55a3da379478 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1362 microversion: 2.1 time: 0.364900 May 16 18:54:39.096858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 376/758] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:38 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:39.497930 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3b7b8f7e-912c-43aa-a4c7-54dc97ae355d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:39.499028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3b7b8f7e-912c-43aa-a4c7-54dc97ae355d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:39.506380 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b7b8f7e-912c-43aa-a4c7-54dc97ae355d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:39.507201 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b7b8f7e-912c-43aa-a4c7-54dc97ae355d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:39.508261 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b7b8f7e-912c-43aa-a4c7-54dc97ae355d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:39.508950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3b7b8f7e-912c-43aa-a4c7-54dc97ae355d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:39.692590 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3b7b8f7e-912c-43aa-a4c7-54dc97ae355d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:39.701910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3b7b8f7e-912c-43aa-a4c7-54dc97ae355d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1519 microversion: 2.1 time: 0.208393 May 16 18:54:39.702654 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 383/759] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:39 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:39.906684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-00e206c7-59e6-4137-ac8f-c73a14ad89f5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:39.908930 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-00e206c7-59e6-4137-ac8f-c73a14ad89f5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:39.918287 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-00e206c7-59e6-4137-ac8f-c73a14ad89f5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:39.919206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-00e206c7-59e6-4137-ac8f-c73a14ad89f5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:39.920737 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-00e206c7-59e6-4137-ac8f-c73a14ad89f5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:39.921411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-00e206c7-59e6-4137-ac8f-c73a14ad89f5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:40.125662 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f8aa494a-6fb2-4ff2-9c9f-fea9e87dcfa1 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:40.127218 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f8aa494a-6fb2-4ff2-9c9f-fea9e87dcfa1 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:40.143339 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f8aa494a-6fb2-4ff2-9c9f-fea9e87dcfa1 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:40.147193 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f8aa494a-6fb2-4ff2-9c9f-fea9e87dcfa1 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:40.151834 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f8aa494a-6fb2-4ff2-9c9f-fea9e87dcfa1 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:40.152837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f8aa494a-6fb2-4ff2-9c9f-fea9e87dcfa1 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:40.200645 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-00e206c7-59e6-4137-ac8f-c73a14ad89f5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:40.213100 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-00e206c7-59e6-4137-ac8f-c73a14ad89f5 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1366 microversion: 2.1 time: 0.311997 May 16 18:54:40.214437 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 377/760] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:39 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:40.360332 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f8aa494a-6fb2-4ff2-9c9f-fea9e87dcfa1 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:40.375392 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f8aa494a-6fb2-4ff2-9c9f-fea9e87dcfa1 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1362 microversion: 2.1 time: 0.264680 May 16 18:54:40.376425 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 384/761] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:40 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:40.652102 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-b0aa3823-98ab-4722-93d1-806043f5ef04 req-bbb9ab2e-1191-49e4-8b0e-33c4fe500360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c93bb74-3b57-4277-9a6b-e8b7569f301d", "name": "network-vif-plugged", "status": "completed", "tag": "2c309251-7e9b-443c-b897-9cf5b018f4b9"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:40.669933 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-b0aa3823-98ab-4722-93d1-806043f5ef04 req-bbb9ab2e-1191-49e4-8b0e-33c4fe500360 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:40.670703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-b0aa3823-98ab-4722-93d1-806043f5ef04 req-bbb9ab2e-1191-49e4-8b0e-33c4fe500360 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:40.722465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d2ad3e11-82b0-4f1f-b6c0-14dcb4da8ff9 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:40.723511 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d2ad3e11-82b0-4f1f-b6c0-14dcb4da8ff9 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:40.731819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-b0aa3823-98ab-4722-93d1-806043f5ef04 req-bbb9ab2e-1191-49e4-8b0e-33c4fe500360 service nova] Creating event network-vif-plugged:2c309251-7e9b-443c-b897-9cf5b018f4b9 for instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d on hv-cinder-75078 May 16 18:54:40.737013 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e11-82b0-4f1f-b6c0-14dcb4da8ff9 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:40.740900 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e11-82b0-4f1f-b6c0-14dcb4da8ff9 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:40.743910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e11-82b0-4f1f-b6c0-14dcb4da8ff9 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:40.744708 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e11-82b0-4f1f-b6c0-14dcb4da8ff9 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:40.750449 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-b0aa3823-98ab-4722-93d1-806043f5ef04 req-bbb9ab2e-1191-49e4-8b0e-33c4fe500360 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248312 May 16 18:54:40.752037 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 378/762] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:41.105471 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d2ad3e11-82b0-4f1f-b6c0-14dcb4da8ff9 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:41.108718 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-2a6bef3e-c506-4f37-b88a-2fc02e38c711 req-06612737-5d5f-47b0-bede-854f91f54794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330d5725-0fac-4ad5-942f-f74fdc9bfbfb", "tag": "2a30c253-e8b1-4a46-acbb-8e869807dac0"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:41.119421 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d2ad3e11-82b0-4f1f-b6c0-14dcb4da8ff9 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1521 microversion: 2.1 time: 0.402244 May 16 18:54:41.120148 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 385/763] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:40 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:41.126970 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-2a6bef3e-c506-4f37-b88a-2fc02e38c711 req-06612737-5d5f-47b0-bede-854f91f54794 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:41.127776 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-2a6bef3e-c506-4f37-b88a-2fc02e38c711 req-06612737-5d5f-47b0-bede-854f91f54794 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:41.141812 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-2a6bef3e-c506-4f37-b88a-2fc02e38c711 req-06612737-5d5f-47b0-bede-854f91f54794 service nova] Creating event network-changed:2a30c253-e8b1-4a46-acbb-8e869807dac0 for instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb on hv-cinder-75078 May 16 18:54:41.151873 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-2a6bef3e-c506-4f37-b88a-2fc02e38c711 req-06612737-5d5f-47b0-bede-854f91f54794 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050376 May 16 18:54:41.152938 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 379/764] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:41.234006 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ffe8525d-92d8-4c90-83bb-f6e8dd3b6fe0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:41.234740 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ffe8525d-92d8-4c90-83bb-f6e8dd3b6fe0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:41.245913 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ffe8525d-92d8-4c90-83bb-f6e8dd3b6fe0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:41.246248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ffe8525d-92d8-4c90-83bb-f6e8dd3b6fe0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:41.247072 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ffe8525d-92d8-4c90-83bb-f6e8dd3b6fe0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:41.247529 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ffe8525d-92d8-4c90-83bb-f6e8dd3b6fe0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:41.406538 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-71aa18c4-7508-4ab5-9233-f37040b381c9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:41.408819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-71aa18c4-7508-4ab5-9233-f37040b381c9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:41.433434 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-71aa18c4-7508-4ab5-9233-f37040b381c9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:41.434535 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-71aa18c4-7508-4ab5-9233-f37040b381c9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:41.437626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-71aa18c4-7508-4ab5-9233-f37040b381c9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:41.438313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-71aa18c4-7508-4ab5-9233-f37040b381c9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:41.486477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ffe8525d-92d8-4c90-83bb-f6e8dd3b6fe0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:41.501923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ffe8525d-92d8-4c90-83bb-f6e8dd3b6fe0 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1366 microversion: 2.1 time: 0.271924 May 16 18:54:41.502634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 386/765] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:41 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:41.609711 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-71aa18c4-7508-4ab5-9233-f37040b381c9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:41.617140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-71aa18c4-7508-4ab5-9233-f37040b381c9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1362 microversion: 2.1 time: 0.218763 May 16 18:54:41.618454 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 380/766] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:41 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:42.136959 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a0c86265-45b5-4e64-966b-d532e1cb1280 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:42.137564 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a0c86265-45b5-4e64-966b-d532e1cb1280 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:42.143984 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a0c86265-45b5-4e64-966b-d532e1cb1280 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:42.144427 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a0c86265-45b5-4e64-966b-d532e1cb1280 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:42.145191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a0c86265-45b5-4e64-966b-d532e1cb1280 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:42.145629 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a0c86265-45b5-4e64-966b-d532e1cb1280 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:42.312385 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a0c86265-45b5-4e64-966b-d532e1cb1280 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:42.322033 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a0c86265-45b5-4e64-966b-d532e1cb1280 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1577 microversion: 2.1 time: 0.189139 May 16 18:54:42.322622 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 387/767] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:42 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:42.522619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e3d3f912-79b9-4278-8be1-863e9c2a4a8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:42.523200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e3d3f912-79b9-4278-8be1-863e9c2a4a8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:42.531658 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e3d3f912-79b9-4278-8be1-863e9c2a4a8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:42.532135 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e3d3f912-79b9-4278-8be1-863e9c2a4a8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:42.532922 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e3d3f912-79b9-4278-8be1-863e9c2a4a8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:42.533375 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e3d3f912-79b9-4278-8be1-863e9c2a4a8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:42.640319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-75780055-56f5-4714-a1c7-6773b76287d9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:42.641382 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-75780055-56f5-4714-a1c7-6773b76287d9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:42.651942 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75780055-56f5-4714-a1c7-6773b76287d9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:42.652418 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75780055-56f5-4714-a1c7-6773b76287d9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:42.653346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75780055-56f5-4714-a1c7-6773b76287d9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:42.653841 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-75780055-56f5-4714-a1c7-6773b76287d9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:42.852569 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e3d3f912-79b9-4278-8be1-863e9c2a4a8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:42.862139 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e3d3f912-79b9-4278-8be1-863e9c2a4a8e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1366 microversion: 2.1 time: 0.345197 May 16 18:54:42.862953 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 381/768] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:42 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:42.870492 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-779856ed-968c-4924-a2df-bf3360a4d0a9 req-25a9d9e3-9c28-4182-9835-145069e0b1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12aa2a80-3944-4ff6-9b34-ada2debe18c5", "name": "network-vif-unplugged", "status": "completed", "tag": "fbd9282a-e554-4f50-b165-7ce5f6ec3daa"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:42.879066 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-779856ed-968c-4924-a2df-bf3360a4d0a9 req-25a9d9e3-9c28-4182-9835-145069e0b1d5 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:42.879505 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-779856ed-968c-4924-a2df-bf3360a4d0a9 req-25a9d9e3-9c28-4182-9835-145069e0b1d5 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:42.893988 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-779856ed-968c-4924-a2df-bf3360a4d0a9 req-25a9d9e3-9c28-4182-9835-145069e0b1d5 service nova] Creating event network-vif-unplugged:fbd9282a-e554-4f50-b165-7ce5f6ec3daa for instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 on hv-cinder-75078 May 16 18:54:42.899741 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-779856ed-968c-4924-a2df-bf3360a4d0a9 req-25a9d9e3-9c28-4182-9835-145069e0b1d5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035171 May 16 18:54:42.900703 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 382/769] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:42.946191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-75780055-56f5-4714-a1c7-6773b76287d9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:42.953957 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-75780055-56f5-4714-a1c7-6773b76287d9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1362 microversion: 2.1 time: 0.321352 May 16 18:54:42.954528 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 388/770] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:42 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:43.340599 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6246bad9-3ed0-4a92-861b-633375f8d1ef tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:43.341506 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6246bad9-3ed0-4a92-861b-633375f8d1ef tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:43.350839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6246bad9-3ed0-4a92-861b-633375f8d1ef tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:43.351286 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6246bad9-3ed0-4a92-861b-633375f8d1ef tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:43.352113 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6246bad9-3ed0-4a92-861b-633375f8d1ef tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:43.352544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6246bad9-3ed0-4a92-861b-633375f8d1ef tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:43.595132 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6246bad9-3ed0-4a92-861b-633375f8d1ef tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:43.604953 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6246bad9-3ed0-4a92-861b-633375f8d1ef tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1577 microversion: 2.1 time: 0.269247 May 16 18:54:43.605719 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 383/771] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:43 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1577 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:43.887563 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-845fa8c7-1dce-4060-9b2e-e7ab246b7420 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:43.888640 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-845fa8c7-1dce-4060-9b2e-e7ab246b7420 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:43.900317 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-845fa8c7-1dce-4060-9b2e-e7ab246b7420 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:43.900811 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-845fa8c7-1dce-4060-9b2e-e7ab246b7420 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:43.901636 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-845fa8c7-1dce-4060-9b2e-e7ab246b7420 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:43.902112 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-845fa8c7-1dce-4060-9b2e-e7ab246b7420 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:43.977339 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4eae7182-bfd9-483c-b2ae-68cf2753e0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:43.978323 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4eae7182-bfd9-483c-b2ae-68cf2753e0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:43.986834 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4eae7182-bfd9-483c-b2ae-68cf2753e0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:43.987498 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4eae7182-bfd9-483c-b2ae-68cf2753e0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:43.988709 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4eae7182-bfd9-483c-b2ae-68cf2753e0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:43.989158 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4eae7182-bfd9-483c-b2ae-68cf2753e0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:44.378796 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-845fa8c7-1dce-4060-9b2e-e7ab246b7420 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:44.390684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-845fa8c7-1dce-4060-9b2e-e7ab246b7420 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1366 microversion: 2.1 time: 0.507856 May 16 18:54:44.391640 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4eae7182-bfd9-483c-b2ae-68cf2753e0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:44.392242 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 389/772] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:43 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1366 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:44.405687 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4eae7182-bfd9-483c-b2ae-68cf2753e0cc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1547 microversion: 2.1 time: 0.434895 May 16 18:54:44.406764 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 384/773] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:43 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1547 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:44.428135 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-35ff7b7a-7a90-4e91-af96-527e2acd8ce6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:44.428997 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-35ff7b7a-7a90-4e91-af96-527e2acd8ce6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:44.438596 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35ff7b7a-7a90-4e91-af96-527e2acd8ce6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:44.439258 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35ff7b7a-7a90-4e91-af96-527e2acd8ce6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:44.440476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35ff7b7a-7a90-4e91-af96-527e2acd8ce6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:44.441042 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35ff7b7a-7a90-4e91-af96-527e2acd8ce6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:44.539931 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-35ff7b7a-7a90-4e91-af96-527e2acd8ce6 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118815 May 16 18:54:44.540522 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 390/774] 10.222.0.72 () {58 vars in 1274 bytes} [Mon May 16 18:54:44 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:44.625208 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-45dae6dd-fd47-4392-af33-ce35831d68b0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:44.625856 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-45dae6dd-fd47-4392-af33-ce35831d68b0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:44.637060 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-45dae6dd-fd47-4392-af33-ce35831d68b0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:44.637060 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-45dae6dd-fd47-4392-af33-ce35831d68b0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:44.640671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-45dae6dd-fd47-4392-af33-ce35831d68b0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:44.640671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-45dae6dd-fd47-4392-af33-ce35831d68b0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:44.903018 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-45dae6dd-fd47-4392-af33-ce35831d68b0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:44.914455 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-45dae6dd-fd47-4392-af33-ce35831d68b0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1577 microversion: 2.1 time: 0.292995 May 16 18:54:44.915683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 385/775] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:44 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1577 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:45.417739 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-95af6b4d-b052-4328-93a5-5d577d2eeeab tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:45.418638 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-95af6b4d-b052-4328-93a5-5d577d2eeeab tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:45.433588 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-95af6b4d-b052-4328-93a5-5d577d2eeeab tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:45.434216 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-95af6b4d-b052-4328-93a5-5d577d2eeeab tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:45.435527 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-95af6b4d-b052-4328-93a5-5d577d2eeeab tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:45.436168 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-95af6b4d-b052-4328-93a5-5d577d2eeeab tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:45.699545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-95af6b4d-b052-4328-93a5-5d577d2eeeab tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:45.710071 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-95af6b4d-b052-4328-93a5-5d577d2eeeab tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1366 microversion: 2.1 time: 0.296517 May 16 18:54:45.712576 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 391/776] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:45 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:45.809483 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-ac44ebbe-6185-4d48-8914-8562af36f365 req-d4d405cb-5cfa-4539-9b2c-1413143a577f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c93bb74-3b57-4277-9a6b-e8b7569f301d", "tag": "2c309251-7e9b-443c-b897-9cf5b018f4b9"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:45.825804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-ac44ebbe-6185-4d48-8914-8562af36f365 req-d4d405cb-5cfa-4539-9b2c-1413143a577f service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:45.826584 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-ac44ebbe-6185-4d48-8914-8562af36f365 req-d4d405cb-5cfa-4539-9b2c-1413143a577f service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:45.848923 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-ac44ebbe-6185-4d48-8914-8562af36f365 req-d4d405cb-5cfa-4539-9b2c-1413143a577f service nova] Creating event network-changed:2c309251-7e9b-443c-b897-9cf5b018f4b9 for instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d on hv-cinder-75078 May 16 18:54:45.858276 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-ac44ebbe-6185-4d48-8914-8562af36f365 req-d4d405cb-5cfa-4539-9b2c-1413143a577f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055480 May 16 18:54:45.859336 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 386/777] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:45.944074 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1ea70fe8-b906-438f-9788-1f7fbdc62c3d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:45.945710 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1ea70fe8-b906-438f-9788-1f7fbdc62c3d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:45.952920 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1ea70fe8-b906-438f-9788-1f7fbdc62c3d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:45.953279 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1ea70fe8-b906-438f-9788-1f7fbdc62c3d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:45.954097 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1ea70fe8-b906-438f-9788-1f7fbdc62c3d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:45.954528 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1ea70fe8-b906-438f-9788-1f7fbdc62c3d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:46.145501 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1ea70fe8-b906-438f-9788-1f7fbdc62c3d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:46.155724 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1ea70fe8-b906-438f-9788-1f7fbdc62c3d tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1577 microversion: 2.1 time: 0.218743 May 16 18:54:46.156492 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 392/778] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:45 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:46.740080 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-af3e4e33-b174-4980-a45e-ffff84167022 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:46.741551 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-af3e4e33-b174-4980-a45e-ffff84167022 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:46.748290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-af3e4e33-b174-4980-a45e-ffff84167022 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:46.749057 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-af3e4e33-b174-4980-a45e-ffff84167022 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:46.750066 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-af3e4e33-b174-4980-a45e-ffff84167022 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:46.750496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-af3e4e33-b174-4980-a45e-ffff84167022 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:47.007505 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-af3e4e33-b174-4980-a45e-ffff84167022 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:47.015244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-af3e4e33-b174-4980-a45e-ffff84167022 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1366 microversion: 2.1 time: 0.281014 May 16 18:54:47.015866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 387/779] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:46 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:47.179321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-99535134-2727-4d4b-b5d6-f5ca392717c6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:47.181547 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-99535134-2727-4d4b-b5d6-f5ca392717c6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:47.191100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-99535134-2727-4d4b-b5d6-f5ca392717c6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:47.192698 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-99535134-2727-4d4b-b5d6-f5ca392717c6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:47.193533 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-99535134-2727-4d4b-b5d6-f5ca392717c6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:47.193980 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-99535134-2727-4d4b-b5d6-f5ca392717c6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:47.371443 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-99535134-2727-4d4b-b5d6-f5ca392717c6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:47.385461 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-99535134-2727-4d4b-b5d6-f5ca392717c6 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1577 microversion: 2.1 time: 0.210319 May 16 18:54:47.386539 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 393/780] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:47 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:48.042736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9963938e-0f11-463f-94fd-aa74841c1dfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:48.043671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9963938e-0f11-463f-94fd-aa74841c1dfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:48.053341 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9963938e-0f11-463f-94fd-aa74841c1dfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:48.053877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9963938e-0f11-463f-94fd-aa74841c1dfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:48.055285 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9963938e-0f11-463f-94fd-aa74841c1dfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:48.055752 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9963938e-0f11-463f-94fd-aa74841c1dfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:48.198638 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9963938e-0f11-463f-94fd-aa74841c1dfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:48.206552 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9963938e-0f11-463f-94fd-aa74841c1dfa tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1366 microversion: 2.1 time: 0.169206 May 16 18:54:48.207161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 388/781] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:48 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:48.404355 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-681b481c-bbaa-4515-9d32-d820174c2c43 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:48.405119 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-681b481c-bbaa-4515-9d32-d820174c2c43 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:48.412829 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-681b481c-bbaa-4515-9d32-d820174c2c43 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:48.413408 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-681b481c-bbaa-4515-9d32-d820174c2c43 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:48.414405 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-681b481c-bbaa-4515-9d32-d820174c2c43 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:48.415010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-681b481c-bbaa-4515-9d32-d820174c2c43 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:48.572835 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-681b481c-bbaa-4515-9d32-d820174c2c43 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:48.581144 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-681b481c-bbaa-4515-9d32-d820174c2c43 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1577 microversion: 2.1 time: 0.182050 May 16 18:54:48.581971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 394/782] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:48 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:48.584204 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-ff98299c-8d41-457a-a49a-17896e438d4f req-fecb3201-fc74-4c15-a694-35e2f8caf518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d5725-0fac-4ad5-942f-f74fdc9bfbfb", "name": "network-vif-plugged", "status": "completed", "tag": "2a30c253-e8b1-4a46-acbb-8e869807dac0"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:48.593863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-ff98299c-8d41-457a-a49a-17896e438d4f req-fecb3201-fc74-4c15-a694-35e2f8caf518 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:48.594496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-ff98299c-8d41-457a-a49a-17896e438d4f req-fecb3201-fc74-4c15-a694-35e2f8caf518 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:48.607960 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-ff98299c-8d41-457a-a49a-17896e438d4f req-fecb3201-fc74-4c15-a694-35e2f8caf518 service nova] Creating event network-vif-plugged:2a30c253-e8b1-4a46-acbb-8e869807dac0 for instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb on hv-cinder-75078 May 16 18:54:48.613136 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-ff98299c-8d41-457a-a49a-17896e438d4f req-fecb3201-fc74-4c15-a694-35e2f8caf518 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034369 May 16 18:54:48.613858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 389/783] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:54:49.228846 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a13b16aa-7ec7-49de-9101-9fe4cffd6ee1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:49.229665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a13b16aa-7ec7-49de-9101-9fe4cffd6ee1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:49.239844 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a13b16aa-7ec7-49de-9101-9fe4cffd6ee1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:49.240915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a13b16aa-7ec7-49de-9101-9fe4cffd6ee1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:49.243072 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a13b16aa-7ec7-49de-9101-9fe4cffd6ee1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:49.243777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a13b16aa-7ec7-49de-9101-9fe4cffd6ee1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:49.417326 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a13b16aa-7ec7-49de-9101-9fe4cffd6ee1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:49.428589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a13b16aa-7ec7-49de-9101-9fe4cffd6ee1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1366 microversion: 2.1 time: 0.206020 May 16 18:54:49.430200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 395/784] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:49 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:49.494184 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6ac1b97d-3aab-42c9-80fe-a69503e7757e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:49.495067 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6ac1b97d-3aab-42c9-80fe-a69503e7757e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:49.501725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ac1b97d-3aab-42c9-80fe-a69503e7757e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:49.502173 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ac1b97d-3aab-42c9-80fe-a69503e7757e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:49.502953 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ac1b97d-3aab-42c9-80fe-a69503e7757e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:49.503405 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ac1b97d-3aab-42c9-80fe-a69503e7757e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:49.529926 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6ac1b97d-3aab-42c9-80fe-a69503e7757e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/ips" status: 200 len: 151 microversion: 2.20 time: 0.040633 May 16 18:54:49.530513 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 390/785] 10.222.0.72 () {60 vars in 1288 bytes} [Mon May 16 18:54:49 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 18:54:49.599551 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-87e5f140-0378-45f9-be78-6c1a7c945b9e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:49.600199 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-87e5f140-0378-45f9-be78-6c1a7c945b9e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:49.606695 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-87e5f140-0378-45f9-be78-6c1a7c945b9e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:49.607146 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-87e5f140-0378-45f9-be78-6c1a7c945b9e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:49.607959 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-87e5f140-0378-45f9-be78-6c1a7c945b9e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:49.608403 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-87e5f140-0378-45f9-be78-6c1a7c945b9e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:49.809867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-87e5f140-0378-45f9-be78-6c1a7c945b9e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:49.819554 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-87e5f140-0378-45f9-be78-6c1a7c945b9e tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1577 microversion: 2.1 time: 0.224693 May 16 18:54:49.820191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 396/786] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:49 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:50.453624 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-59082bb7-cb25-4f84-a249-2055b6461583 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:50.454349 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-59082bb7-cb25-4f84-a249-2055b6461583 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:50.460493 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-59082bb7-cb25-4f84-a249-2055b6461583 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:50.461188 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-59082bb7-cb25-4f84-a249-2055b6461583 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:50.462051 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-59082bb7-cb25-4f84-a249-2055b6461583 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:50.462563 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-59082bb7-cb25-4f84-a249-2055b6461583 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:50.647411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-59082bb7-cb25-4f84-a249-2055b6461583 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:50.649327 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-7f0540d8-35d7-4f3a-9635-7a34a528d2ad req-4f178ea7-fbf2-4631-bdef-adfea51b14b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12aa2a80-3944-4ff6-9b34-ada2debe18c5", "name": "network-vif-plugged", "status": "completed", "tag": "fbd9282a-e554-4f50-b165-7ce5f6ec3daa"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:50.655891 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-59082bb7-cb25-4f84-a249-2055b6461583 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1366 microversion: 2.1 time: 0.206254 May 16 18:54:50.656483 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 391/787] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:50 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:50.661197 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-7f0540d8-35d7-4f3a-9635-7a34a528d2ad req-4f178ea7-fbf2-4631-bdef-adfea51b14b5 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:50.661642 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-7f0540d8-35d7-4f3a-9635-7a34a528d2ad req-4f178ea7-fbf2-4631-bdef-adfea51b14b5 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:50.675499 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-7f0540d8-35d7-4f3a-9635-7a34a528d2ad req-4f178ea7-fbf2-4631-bdef-adfea51b14b5 service nova] Creating event network-vif-plugged:fbd9282a-e554-4f50-b165-7ce5f6ec3daa for instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 on hv-cinder-75078 May 16 18:54:50.681504 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-7f0540d8-35d7-4f3a-9635-7a34a528d2ad req-4f178ea7-fbf2-4631-bdef-adfea51b14b5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038689 May 16 18:54:50.682260 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 397/788] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:54:50.841140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b9460e26-2ab1-43b5-af60-c32dbd25f900 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:50.841662 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b9460e26-2ab1-43b5-af60-c32dbd25f900 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:50.848224 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9460e26-2ab1-43b5-af60-c32dbd25f900 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:50.848668 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9460e26-2ab1-43b5-af60-c32dbd25f900 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:50.849468 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9460e26-2ab1-43b5-af60-c32dbd25f900 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:50.849901 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b9460e26-2ab1-43b5-af60-c32dbd25f900 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:51.009516 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b9460e26-2ab1-43b5-af60-c32dbd25f900 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:51.018610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b9460e26-2ab1-43b5-af60-c32dbd25f900 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1577 microversion: 2.1 time: 0.181291 May 16 18:54:51.019522 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 392/789] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:50 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:51.681901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-68e6cd1f-7e09-4992-a065-d117558ecfb3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:51.683157 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-68e6cd1f-7e09-4992-a065-d117558ecfb3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:51.694025 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-68e6cd1f-7e09-4992-a065-d117558ecfb3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:51.694736 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-68e6cd1f-7e09-4992-a065-d117558ecfb3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:51.697348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-68e6cd1f-7e09-4992-a065-d117558ecfb3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:51.698137 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-68e6cd1f-7e09-4992-a065-d117558ecfb3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:51.872136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-68e6cd1f-7e09-4992-a065-d117558ecfb3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:51.884999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-68e6cd1f-7e09-4992-a065-d117558ecfb3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1555 microversion: 2.1 time: 0.211826 May 16 18:54:51.885692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 398/790] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:51 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:51.903741 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-bdc79fef-1dfd-4fe5-a5dc-8d4572022f83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:51.904418 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-bdc79fef-1dfd-4fe5-a5dc-8d4572022f83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:51.911321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bdc79fef-1dfd-4fe5-a5dc-8d4572022f83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:51.912160 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bdc79fef-1dfd-4fe5-a5dc-8d4572022f83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:51.913039 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bdc79fef-1dfd-4fe5-a5dc-8d4572022f83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:51.913396 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bdc79fef-1dfd-4fe5-a5dc-8d4572022f83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:52.013660 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-bdc79fef-1dfd-4fe5-a5dc-8d4572022f83 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112353 May 16 18:54:52.013660 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 393/791] 10.222.0.72 () {58 vars in 1274 bytes} [Mon May 16 18:54:51 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:54:52.040953 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b3d887cb-78af-4dae-9f99-fa48cbf63e38 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:52.041577 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b3d887cb-78af-4dae-9f99-fa48cbf63e38 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:52.047687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b3d887cb-78af-4dae-9f99-fa48cbf63e38 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:52.048170 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b3d887cb-78af-4dae-9f99-fa48cbf63e38 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:52.048945 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b3d887cb-78af-4dae-9f99-fa48cbf63e38 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:52.049385 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b3d887cb-78af-4dae-9f99-fa48cbf63e38 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:52.230802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b3d887cb-78af-4dae-9f99-fa48cbf63e38 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:52.245839 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b3d887cb-78af-4dae-9f99-fa48cbf63e38 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1577 microversion: 2.1 time: 0.205079 May 16 18:54:52.245839 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 399/792] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:52 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:54:52.334215 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-efc765a8-f955-40a6-af3b-2976e620cc9e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:52.335062 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-efc765a8-f955-40a6-af3b-2976e620cc9e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:52.347542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-efc765a8-f955-40a6-af3b-2976e620cc9e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:52.348377 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-efc765a8-f955-40a6-af3b-2976e620cc9e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:52.349781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-efc765a8-f955-40a6-af3b-2976e620cc9e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:52.350569 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-efc765a8-f955-40a6-af3b-2976e620cc9e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:52.407007 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-efc765a8-f955-40a6-af3b-2976e620cc9e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lazy-loading 'flavor' on Instance uuid 86b2dd21-9b22-4230-8bee-d6f04f06019f {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:54:52.753366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-efc765a8-f955-40a6-af3b-2976e620cc9e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "POST /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/action" status: 202 len: 0 microversion: 2.20 time: 0.426267 May 16 18:54:52.758428 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 394/793] 10.222.0.72 () {62 vars in 1318 bytes} [Mon May 16 18:54:52 2022] POST /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 18:54:52.764492 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0050a289-d28b-4aec-a7cc-3833a66c0e17 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:52.765463 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0050a289-d28b-4aec-a7cc-3833a66c0e17 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:52.773834 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0050a289-d28b-4aec-a7cc-3833a66c0e17 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:52.774341 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0050a289-d28b-4aec-a7cc-3833a66c0e17 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:52.775227 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0050a289-d28b-4aec-a7cc-3833a66c0e17 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:52.775774 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0050a289-d28b-4aec-a7cc-3833a66c0e17 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:52.987982 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0050a289-d28b-4aec-a7cc-3833a66c0e17 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:52.997934 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0050a289-d28b-4aec-a7cc-3833a66c0e17 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:53.000571 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0050a289-d28b-4aec-a7cc-3833a66c0e17 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:53.002348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0050a289-d28b-4aec-a7cc-3833a66c0e17 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.242710 May 16 18:54:53.003075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 400/794] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:54:52 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:54:53.267151 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-880b39cd-83ba-4ba0-b211-4a1f9d9ef7eb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:53.268543 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-880b39cd-83ba-4ba0-b211-4a1f9d9ef7eb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:53.281124 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-880b39cd-83ba-4ba0-b211-4a1f9d9ef7eb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:53.281920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-880b39cd-83ba-4ba0-b211-4a1f9d9ef7eb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:53.283287 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-880b39cd-83ba-4ba0-b211-4a1f9d9ef7eb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:53.284386 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-880b39cd-83ba-4ba0-b211-4a1f9d9ef7eb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:53.310930 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-b3b89885-511e-4548-baeb-a6231cf6427d req-95af724f-b31c-4f06-a229-d095a10ea4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330d5725-0fac-4ad5-942f-f74fdc9bfbfb", "tag": "2a30c253-e8b1-4a46-acbb-8e869807dac0"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:54:53.320369 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-b3b89885-511e-4548-baeb-a6231cf6427d req-95af724f-b31c-4f06-a229-d095a10ea4bc service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:53.321095 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-b3b89885-511e-4548-baeb-a6231cf6427d req-95af724f-b31c-4f06-a229-d095a10ea4bc service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:53.333954 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-b3b89885-511e-4548-baeb-a6231cf6427d req-95af724f-b31c-4f06-a229-d095a10ea4bc service nova] Creating event network-changed:2a30c253-e8b1-4a46-acbb-8e869807dac0 for instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb on hv-cinder-75078 May 16 18:54:53.340158 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-b3b89885-511e-4548-baeb-a6231cf6427d req-95af724f-b31c-4f06-a229-d095a10ea4bc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033030 May 16 18:54:53.341142 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 401/795] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:54:53.484391 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-880b39cd-83ba-4ba0-b211-4a1f9d9ef7eb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:53.496719 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-880b39cd-83ba-4ba0-b211-4a1f9d9ef7eb tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1564 microversion: 2.1 time: 0.238647 May 16 18:54:53.497498 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 395/796] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:54:53 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1564 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:54:54.028081 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d9427570-29f5-424e-b8c0-03ea8f8a7e37 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:54.029244 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d9427570-29f5-424e-b8c0-03ea8f8a7e37 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:54.043029 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d9427570-29f5-424e-b8c0-03ea8f8a7e37 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:54.043864 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d9427570-29f5-424e-b8c0-03ea8f8a7e37 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:54.045321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d9427570-29f5-424e-b8c0-03ea8f8a7e37 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:54.046112 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d9427570-29f5-424e-b8c0-03ea8f8a7e37 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:54.293377 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d9427570-29f5-424e-b8c0-03ea8f8a7e37 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:54.302356 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d9427570-29f5-424e-b8c0-03ea8f8a7e37 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:54.304044 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d9427570-29f5-424e-b8c0-03ea8f8a7e37 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:54.306940 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d9427570-29f5-424e-b8c0-03ea8f8a7e37 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.285786 May 16 18:54:54.306940 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 402/797] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:54:54 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:54:55.325665 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5f2c2a70-d60a-4d93-8c5a-3af55b34c139 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:55.326647 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5f2c2a70-d60a-4d93-8c5a-3af55b34c139 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:55.333381 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f2c2a70-d60a-4d93-8c5a-3af55b34c139 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:55.333829 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f2c2a70-d60a-4d93-8c5a-3af55b34c139 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:55.334598 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f2c2a70-d60a-4d93-8c5a-3af55b34c139 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:55.335050 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f2c2a70-d60a-4d93-8c5a-3af55b34c139 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:55.506847 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5f2c2a70-d60a-4d93-8c5a-3af55b34c139 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:55.521960 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5f2c2a70-d60a-4d93-8c5a-3af55b34c139 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:55.525841 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5f2c2a70-d60a-4d93-8c5a-3af55b34c139 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:55.528338 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5f2c2a70-d60a-4d93-8c5a-3af55b34c139 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.206936 May 16 18:54:55.540287 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 396/798] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:54:55 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:54:56.549742 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-be6c3d60-f15b-4343-b7ba-37b86923fe67 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:56.550487 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-be6c3d60-f15b-4343-b7ba-37b86923fe67 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:56.558929 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be6c3d60-f15b-4343-b7ba-37b86923fe67 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:56.559376 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be6c3d60-f15b-4343-b7ba-37b86923fe67 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:56.560192 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be6c3d60-f15b-4343-b7ba-37b86923fe67 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:56.560633 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be6c3d60-f15b-4343-b7ba-37b86923fe67 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:56.718513 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-be6c3d60-f15b-4343-b7ba-37b86923fe67 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:56.734165 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-be6c3d60-f15b-4343-b7ba-37b86923fe67 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:56.736941 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-be6c3d60-f15b-4343-b7ba-37b86923fe67 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:56.738955 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-be6c3d60-f15b-4343-b7ba-37b86923fe67 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.194090 May 16 18:54:56.739966 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 403/799] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:54:56 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:54:57.761752 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-00ddc605-08d4-464b-a143-64fc9faf4710 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:57.762306 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-00ddc605-08d4-464b-a143-64fc9faf4710 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:57.772038 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-00ddc605-08d4-464b-a143-64fc9faf4710 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:57.772609 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-00ddc605-08d4-464b-a143-64fc9faf4710 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:57.774660 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-00ddc605-08d4-464b-a143-64fc9faf4710 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:57.775419 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-00ddc605-08d4-464b-a143-64fc9faf4710 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:57.937164 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-00ddc605-08d4-464b-a143-64fc9faf4710 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:57.945818 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-00ddc605-08d4-464b-a143-64fc9faf4710 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:57.947453 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-00ddc605-08d4-464b-a143-64fc9faf4710 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:57.948811 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-00ddc605-08d4-464b-a143-64fc9faf4710 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.192062 May 16 18:54:57.949376 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 397/800] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:54:57 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:54:58.972637 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-851e1500-bf45-4d35-9aef-4147e99da327 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:54:58.973769 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-851e1500-bf45-4d35-9aef-4147e99da327 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:54:58.985350 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-851e1500-bf45-4d35-9aef-4147e99da327 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:58.986142 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-851e1500-bf45-4d35-9aef-4147e99da327 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:58.987502 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-851e1500-bf45-4d35-9aef-4147e99da327 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:54:58.988314 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-851e1500-bf45-4d35-9aef-4147e99da327 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:54:59.159915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-851e1500-bf45-4d35-9aef-4147e99da327 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:59.174220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-851e1500-bf45-4d35-9aef-4147e99da327 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:59.175739 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-851e1500-bf45-4d35-9aef-4147e99da327 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:54:59.176910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-851e1500-bf45-4d35-9aef-4147e99da327 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.211344 May 16 18:54:59.177473 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 404/801] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:54:58 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:00.198633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-361b7298-15b8-4a97-8acf-f335d817939c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:00.199496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-361b7298-15b8-4a97-8acf-f335d817939c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:00.206412 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-361b7298-15b8-4a97-8acf-f335d817939c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:00.206861 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-361b7298-15b8-4a97-8acf-f335d817939c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:00.207638 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-361b7298-15b8-4a97-8acf-f335d817939c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:00.208102 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-361b7298-15b8-4a97-8acf-f335d817939c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:00.363542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-361b7298-15b8-4a97-8acf-f335d817939c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:00.376302 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-361b7298-15b8-4a97-8acf-f335d817939c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:00.380756 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-361b7298-15b8-4a97-8acf-f335d817939c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:00.380756 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-361b7298-15b8-4a97-8acf-f335d817939c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.188028 May 16 18:55:00.389084 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 398/802] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:00 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:01.410813 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-eda5b543-2947-46c7-9cc9-df885e48f8b9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:01.411914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-eda5b543-2947-46c7-9cc9-df885e48f8b9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:01.420957 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eda5b543-2947-46c7-9cc9-df885e48f8b9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:01.421406 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eda5b543-2947-46c7-9cc9-df885e48f8b9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:01.422200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eda5b543-2947-46c7-9cc9-df885e48f8b9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:01.422633 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eda5b543-2947-46c7-9cc9-df885e48f8b9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:01.586989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-eda5b543-2947-46c7-9cc9-df885e48f8b9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:01.602199 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-eda5b543-2947-46c7-9cc9-df885e48f8b9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:01.605167 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-eda5b543-2947-46c7-9cc9-df885e48f8b9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:01.606637 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-eda5b543-2947-46c7-9cc9-df885e48f8b9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.199729 May 16 18:55:01.607221 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 405/803] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:01 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:02.625172 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-180549ff-0f50-4bb2-affa-420965471b50 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:02.625930 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-180549ff-0f50-4bb2-affa-420965471b50 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:02.632682 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-180549ff-0f50-4bb2-affa-420965471b50 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:02.633114 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-180549ff-0f50-4bb2-affa-420965471b50 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:02.633886 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-180549ff-0f50-4bb2-affa-420965471b50 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:02.634320 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-180549ff-0f50-4bb2-affa-420965471b50 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:02.829770 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-180549ff-0f50-4bb2-affa-420965471b50 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:02.840645 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-180549ff-0f50-4bb2-affa-420965471b50 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:02.842401 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-180549ff-0f50-4bb2-affa-420965471b50 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:02.843563 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-180549ff-0f50-4bb2-affa-420965471b50 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.222439 May 16 18:55:02.844163 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 399/804] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:02 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:03.863146 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d599f214-e6af-4921-a9ae-3d4b1bb2b177 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:03.863799 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d599f214-e6af-4921-a9ae-3d4b1bb2b177 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:03.871087 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d599f214-e6af-4921-a9ae-3d4b1bb2b177 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:03.871534 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d599f214-e6af-4921-a9ae-3d4b1bb2b177 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:03.872336 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d599f214-e6af-4921-a9ae-3d4b1bb2b177 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:03.872767 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d599f214-e6af-4921-a9ae-3d4b1bb2b177 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:04.021499 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d599f214-e6af-4921-a9ae-3d4b1bb2b177 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:04.034143 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d599f214-e6af-4921-a9ae-3d4b1bb2b177 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:04.036336 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d599f214-e6af-4921-a9ae-3d4b1bb2b177 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:04.038038 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d599f214-e6af-4921-a9ae-3d4b1bb2b177 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.178634 May 16 18:55:04.039700 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 406/805] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:03 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:04.587214 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6acfc182-ddfe-4b7e-8ecc-11c8b578fe17 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:04.588078 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6acfc182-ddfe-4b7e-8ecc-11c8b578fe17 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:04.595595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6acfc182-ddfe-4b7e-8ecc-11c8b578fe17 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:04.596245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6acfc182-ddfe-4b7e-8ecc-11c8b578fe17 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:04.597235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6acfc182-ddfe-4b7e-8ecc-11c8b578fe17 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:04.597707 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6acfc182-ddfe-4b7e-8ecc-11c8b578fe17 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:04.630222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6acfc182-ddfe-4b7e-8ecc-11c8b578fe17 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:55:04.727668 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6acfc182-ddfe-4b7e-8ecc-11c8b578fe17 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 204 len: 0 microversion: 2.1 time: 0.147402 May 16 18:55:04.728372 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 400/806] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:55:04 2022] DELETE /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 18:55:04.738165 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-50cbea46-a9e6-475b-bb8a-2b41d6900bdd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:04.738785 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-50cbea46-a9e6-475b-bb8a-2b41d6900bdd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:04.745151 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50cbea46-a9e6-475b-bb8a-2b41d6900bdd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:04.745602 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50cbea46-a9e6-475b-bb8a-2b41d6900bdd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:04.746386 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50cbea46-a9e6-475b-bb8a-2b41d6900bdd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:04.746825 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50cbea46-a9e6-475b-bb8a-2b41d6900bdd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:04.915548 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-50cbea46-a9e6-475b-bb8a-2b41d6900bdd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:04.923830 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-50cbea46-a9e6-475b-bb8a-2b41d6900bdd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1577 microversion: 2.1 time: 0.190075 May 16 18:55:04.924434 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 407/807] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:04 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:05.058321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f5aea698-f7b8-4742-aac8-876be9361336 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:05.059019 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f5aea698-f7b8-4742-aac8-876be9361336 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:05.065496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f5aea698-f7b8-4742-aac8-876be9361336 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:05.065999 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f5aea698-f7b8-4742-aac8-876be9361336 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:05.066879 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f5aea698-f7b8-4742-aac8-876be9361336 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:05.067390 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f5aea698-f7b8-4742-aac8-876be9361336 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:05.229224 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f5aea698-f7b8-4742-aac8-876be9361336 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:05.238041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f5aea698-f7b8-4742-aac8-876be9361336 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:05.240096 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f5aea698-f7b8-4742-aac8-876be9361336 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:05.242493 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f5aea698-f7b8-4742-aac8-876be9361336 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.188377 May 16 18:55:05.243427 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 401/808] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:05 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:05.946206 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6333a1ef-cc37-468e-bda4-2c6863ac7e96 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:05.947288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6333a1ef-cc37-468e-bda4-2c6863ac7e96 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:05.956591 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6333a1ef-cc37-468e-bda4-2c6863ac7e96 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:05.957224 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6333a1ef-cc37-468e-bda4-2c6863ac7e96 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:05.958644 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6333a1ef-cc37-468e-bda4-2c6863ac7e96 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:05.959422 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6333a1ef-cc37-468e-bda4-2c6863ac7e96 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:06.127305 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6333a1ef-cc37-468e-bda4-2c6863ac7e96 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:06.136318 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6333a1ef-cc37-468e-bda4-2c6863ac7e96 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1577 microversion: 2.1 time: 0.197160 May 16 18:55:06.136916 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 408/809] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:05 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:06.264594 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-47992259-80fb-44a1-be05-c6c270b347c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:06.265337 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-47992259-80fb-44a1-be05-c6c270b347c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:06.274902 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-47992259-80fb-44a1-be05-c6c270b347c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:06.275354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-47992259-80fb-44a1-be05-c6c270b347c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:06.276184 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-47992259-80fb-44a1-be05-c6c270b347c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:06.276628 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-47992259-80fb-44a1-be05-c6c270b347c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:06.447467 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-47992259-80fb-44a1-be05-c6c270b347c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:06.457783 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-47992259-80fb-44a1-be05-c6c270b347c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:06.459261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-47992259-80fb-44a1-be05-c6c270b347c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:06.460492 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-47992259-80fb-44a1-be05-c6c270b347c5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.199987 May 16 18:55:06.461052 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 402/810] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:06 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:07.154697 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b35b82a6-d3ba-42df-9f3d-361df9509b74 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:07.155314 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b35b82a6-d3ba-42df-9f3d-361df9509b74 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:07.162570 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b35b82a6-d3ba-42df-9f3d-361df9509b74 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:07.163021 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b35b82a6-d3ba-42df-9f3d-361df9509b74 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:07.164397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b35b82a6-d3ba-42df-9f3d-361df9509b74 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:07.164832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b35b82a6-d3ba-42df-9f3d-361df9509b74 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:07.480107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1f99de93-dedd-46df-b14a-8c4afed8642e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:07.480913 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1f99de93-dedd-46df-b14a-8c4afed8642e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:07.490105 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1f99de93-dedd-46df-b14a-8c4afed8642e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:07.490617 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1f99de93-dedd-46df-b14a-8c4afed8642e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:07.491530 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1f99de93-dedd-46df-b14a-8c4afed8642e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:07.492106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1f99de93-dedd-46df-b14a-8c4afed8642e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:07.681971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b35b82a6-d3ba-42df-9f3d-361df9509b74 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:07.690457 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b35b82a6-d3ba-42df-9f3d-361df9509b74 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1577 microversion: 2.1 time: 0.539536 May 16 18:55:07.691050 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 409/811] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:07 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1577 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:07.748794 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1f99de93-dedd-46df-b14a-8c4afed8642e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:07.757484 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1f99de93-dedd-46df-b14a-8c4afed8642e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:07.759071 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1f99de93-dedd-46df-b14a-8c4afed8642e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:07.760438 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1f99de93-dedd-46df-b14a-8c4afed8642e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.285579 May 16 18:55:07.761238 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 403/812] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:07 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:08.231744 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-64f25388-f7fb-46d2-8aef-88eef9c5507b req-d2715afe-0b9e-4bb9-801c-8a1dcb72b9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f61265-a9db-48ea-a142-5238bf17239d", "name": "network-vif-deleted", "tag": "3ba065e3-302f-4b58-b666-92ac520ffc00"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:08.259633 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-64f25388-f7fb-46d2-8aef-88eef9c5507b req-d2715afe-0b9e-4bb9-801c-8a1dcb72b9c7 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:08.260481 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-64f25388-f7fb-46d2-8aef-88eef9c5507b req-d2715afe-0b9e-4bb9-801c-8a1dcb72b9c7 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:08.280396 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-64f25388-f7fb-46d2-8aef-88eef9c5507b req-d2715afe-0b9e-4bb9-801c-8a1dcb72b9c7 service nova] Creating event network-vif-deleted:3ba065e3-302f-4b58-b666-92ac520ffc00 for instance f9f61265-a9db-48ea-a142-5238bf17239d on hv-cinder-75078 May 16 18:55:08.289487 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-64f25388-f7fb-46d2-8aef-88eef9c5507b req-d2715afe-0b9e-4bb9-801c-8a1dcb72b9c7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071977 May 16 18:55:08.291194 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 410/813] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:55:08.714777 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:08.716724 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:08.730584 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:08.731370 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:08.736159 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:08.736822 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:08.787482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3d5f4ee2-5896-49af-91c2-7b59aa4969e4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:08.789096 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3d5f4ee2-5896-49af-91c2-7b59aa4969e4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:08.798501 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d5f4ee2-5896-49af-91c2-7b59aa4969e4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:08.798959 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d5f4ee2-5896-49af-91c2-7b59aa4969e4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:08.799835 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d5f4ee2-5896-49af-91c2-7b59aa4969e4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:08.800276 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3d5f4ee2-5896-49af-91c2-7b59aa4969e4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:08.803357 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:08.804355 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:08.805239 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lazy-loading 'fault' on Instance uuid f9f61265-a9db-48ea-a142-5238bf17239d {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:55:08.874261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:08.891475 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-43f309c4-2153-4d16-bd0a-c3ff09452b93 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 200 len: 1230 microversion: 2.1 time: 0.184314 May 16 18:55:08.893089 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 404/814] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:08 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 1230 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:09.049093 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3d5f4ee2-5896-49af-91c2-7b59aa4969e4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:09.060935 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3d5f4ee2-5896-49af-91c2-7b59aa4969e4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:09.063007 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3d5f4ee2-5896-49af-91c2-7b59aa4969e4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:09.064598 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3d5f4ee2-5896-49af-91c2-7b59aa4969e4 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1742 microversion: 2.20 time: 0.284667 May 16 18:55:09.065229 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 411/815] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:08 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1742 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:09.911084 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4068a8e4-4db8-4ab2-ac68-db6aa6f58cc8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:09.911763 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4068a8e4-4db8-4ab2-ac68-db6aa6f58cc8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:09.918537 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4068a8e4-4db8-4ab2-ac68-db6aa6f58cc8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:09.918982 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4068a8e4-4db8-4ab2-ac68-db6aa6f58cc8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:09.919783 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4068a8e4-4db8-4ab2-ac68-db6aa6f58cc8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:09.920219 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4068a8e4-4db8-4ab2-ac68-db6aa6f58cc8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:09.934602 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-4068a8e4-4db8-4ab2-ac68-db6aa6f58cc8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] HTTP exception thrown: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4068a8e4-4db8-4ab2-ac68-db6aa6f58cc8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Request method failure captured: May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d HTTP/1.1 May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigp0ctcFRe8IRwshvpn60txg7kjLxd78mw2FNSVbypy6EOg7Tx_r9brAsWIc1PT2wNvbFTnYR-A5aHBqWMV0idIk_aliJtkmHEtvXKnOlBZ0GUzGdffk_HJN_LbaqrXgfYnSNXSmoe9c59uNA9iY9kIMl8wilMwnir8eww3JC06AxNQA May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 5b168bfd42a645269b47c98f4210e4aa May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-TestVolumeBootPattern-325784663 May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:55:09.936234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-TestVolumeBootPattern-325784663 May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 5b168bfd42a645269b47c98f4210e4aa May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-TestVolumeBootPattern-325784663 May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-TestVolumeBootPattern-325784663-project May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 5e9ebfaac4984817bb768476ef74445c May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-TestVolumeBootPattern-325784663-project May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 18:55:09.938781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': 'f9f61265-a9db-48ea-a142-5238bf17239d'} May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:55:09.939858 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 18:55:09.942460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:09.945073 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4068a8e4-4db8-4ab2-ac68-db6aa6f58cc8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Returning 404 to user: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:55:09.945073 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4068a8e4-4db8-4ab2-ac68-db6aa6f58cc8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 404 len: 111 microversion: 2.1 time: 0.030788 May 16 18:55:09.945073 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 405/816] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:09 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 18:55:10.056118 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-966894226", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-426666422", "security_groups": [{"name": "tempest-secgroup-smoke-1652304659"}], "block_device_mapping_v2": [{"uuid": "59bc089c-ebd6-4185-8a6e-c3db1969da74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bdc43d0-da09-483c-a5e7-ef200c0654fb"}]}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:10.087013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8c9b8b4a-f8fc-464a-bd79-63184c4d3192 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:10.087616 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8c9b8b4a-f8fc-464a-bd79-63184c4d3192 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:10.094099 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8c9b8b4a-f8fc-464a-bd79-63184c4d3192 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:10.094542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8c9b8b4a-f8fc-464a-bd79-63184c4d3192 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:10.095311 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8c9b8b4a-f8fc-464a-bd79-63184c4d3192 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:10.095768 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8c9b8b4a-f8fc-464a-bd79-63184c4d3192 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:10.229308 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.network.neutron [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] validate_networks() for [('3bdc43d0-da09-483c-a5e7-ef200c0654fb', None, None, None, None, None)] {{(pid=128886) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:55:10.346562 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8c9b8b4a-f8fc-464a-bd79-63184c4d3192 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:10.356122 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8c9b8b4a-f8fc-464a-bd79-63184c4d3192 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:10.357697 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8c9b8b4a-f8fc-464a-bd79-63184c4d3192 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:10.358908 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8c9b8b4a-f8fc-464a-bd79-63184c4d3192 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1742 microversion: 2.20 time: 0.276332 May 16 18:55:10.359606 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 406/817] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:10 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1742 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:10.738794 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Flavor limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:55:10.739531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Image limits 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:55:10.740446 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Flavor pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:55:10.741707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Image pref 0:0:0 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:55:10.742531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.virt.hardware [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:55:10.756098 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:10.756562 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:10.758819 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:10.759491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:10.785883 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Getting quotas for project 5b168bfd42a645269b47c98f4210e4aa. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:55:10.790502 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.quota [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Getting quotas for user 5e9ebfaac4984817bb768476ef74445c and project 5b168bfd42a645269b47c98f4210e4aa. Resources: {'ram', 'cores', 'instances'} {{(pid=128886) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:55:10.856414 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Going to run 1 instances... {{(pid=128886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:55:10.858778 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59bc089c-ebd6-4185-8a6e-c3db1969da74',volume_size=None,volume_type=None)] {{(pid=128886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:55:11.036056 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b36039f7-bbc2-4ea7-92b8-a0f81a90a687 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.987324 May 16 18:55:11.037621 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 412/818] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:55:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:55:11.053082 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-af18ac65-3529-4213-ae78-97ce5874afae tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:11.053082 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-af18ac65-3529-4213-ae78-97ce5874afae tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:11.126526 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-af18ac65-3529-4213-ae78-97ce5874afae tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:11.134899 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-af18ac65-3529-4213-ae78-97ce5874afae tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1093 microversion: 2.1 time: 0.087510 May 16 18:55:11.134899 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 407/819] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:11 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:11.383477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6bb1074e-d916-43c0-8c2a-23d6f162be1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:11.384857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6bb1074e-d916-43c0-8c2a-23d6f162be1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:11.395511 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6bb1074e-d916-43c0-8c2a-23d6f162be1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:11.399926 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6bb1074e-d916-43c0-8c2a-23d6f162be1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:11.401164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6bb1074e-d916-43c0-8c2a-23d6f162be1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:11.401813 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6bb1074e-d916-43c0-8c2a-23d6f162be1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:11.607268 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6bb1074e-d916-43c0-8c2a-23d6f162be1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:11.620996 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6bb1074e-d916-43c0-8c2a-23d6f162be1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:11.623883 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6bb1074e-d916-43c0-8c2a-23d6f162be1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:11.626096 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6bb1074e-d916-43c0-8c2a-23d6f162be1f tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1737 microversion: 2.20 time: 0.251252 May 16 18:55:11.626992 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 413/820] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:11 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:12.153987 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6c993935-633c-4cde-a751-f8f9f387fbe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:12.155830 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6c993935-633c-4cde-a751-f8f9f387fbe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:12.165523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6c993935-633c-4cde-a751-f8f9f387fbe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:12.166070 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6c993935-633c-4cde-a751-f8f9f387fbe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:12.166925 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6c993935-633c-4cde-a751-f8f9f387fbe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:12.167430 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6c993935-633c-4cde-a751-f8f9f387fbe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:12.246980 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6c993935-633c-4cde-a751-f8f9f387fbe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:12.259674 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6c993935-633c-4cde-a751-f8f9f387fbe7 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1191 microversion: 2.1 time: 0.109966 May 16 18:55:12.273526 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 408/821] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:12 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:12.654375 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1d48618b-f855-43a4-81db-d323175b3cb9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:12.655163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1d48618b-f855-43a4-81db-d323175b3cb9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:12.664398 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1d48618b-f855-43a4-81db-d323175b3cb9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:12.676391 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1d48618b-f855-43a4-81db-d323175b3cb9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:12.677492 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1d48618b-f855-43a4-81db-d323175b3cb9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:12.678206 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1d48618b-f855-43a4-81db-d323175b3cb9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:12.792579 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-ee654fbf-7051-4aad-9dce-45cff3037da8 req-f51bd342-e90a-4f85-b4a4-99cbe2f6537d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b2dd21-9b22-4230-8bee-d6f04f06019f", "name": "network-vif-plugged", "status": "completed", "tag": "7c023405-87f2-4ed0-9c4c-c419d714714d"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:12.814452 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-ee654fbf-7051-4aad-9dce-45cff3037da8 req-f51bd342-e90a-4f85-b4a4-99cbe2f6537d service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:12.814909 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-ee654fbf-7051-4aad-9dce-45cff3037da8 req-f51bd342-e90a-4f85-b4a4-99cbe2f6537d service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:12.841058 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-ee654fbf-7051-4aad-9dce-45cff3037da8 req-f51bd342-e90a-4f85-b4a4-99cbe2f6537d service nova] Creating event network-vif-plugged:7c023405-87f2-4ed0-9c4c-c419d714714d for instance 86b2dd21-9b22-4230-8bee-d6f04f06019f on hv-cinder-75078 May 16 18:55:12.858772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-ee654fbf-7051-4aad-9dce-45cff3037da8 req-f51bd342-e90a-4f85-b4a4-99cbe2f6537d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071491 May 16 18:55:12.859395 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 409/822] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:55:13.093087 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1d48618b-f855-43a4-81db-d323175b3cb9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:13.130615 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1d48618b-f855-43a4-81db-d323175b3cb9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:13.134357 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1d48618b-f855-43a4-81db-d323175b3cb9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:13.137456 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1d48618b-f855-43a4-81db-d323175b3cb9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1737 microversion: 2.20 time: 0.491287 May 16 18:55:13.139609 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 414/823] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:12 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1737 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:13.289747 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6ddab18b-c462-4d5a-bd34-c03e8ed6ddd2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:13.290622 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6ddab18b-c462-4d5a-bd34-c03e8ed6ddd2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:13.302771 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ddab18b-c462-4d5a-bd34-c03e8ed6ddd2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:13.306726 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ddab18b-c462-4d5a-bd34-c03e8ed6ddd2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:13.308978 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ddab18b-c462-4d5a-bd34-c03e8ed6ddd2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:13.311178 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ddab18b-c462-4d5a-bd34-c03e8ed6ddd2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:13.456727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6ddab18b-c462-4d5a-bd34-c03e8ed6ddd2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:13.473844 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6ddab18b-c462-4d5a-bd34-c03e8ed6ddd2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1209 microversion: 2.1 time: 0.191909 May 16 18:55:13.475007 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 410/824] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:13 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1209 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:14.171733 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-00e5fb87-4e92-487c-bc9e-9f823c8393ee tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:14.172560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-00e5fb87-4e92-487c-bc9e-9f823c8393ee tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:14.187438 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-00e5fb87-4e92-487c-bc9e-9f823c8393ee tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:14.188277 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-00e5fb87-4e92-487c-bc9e-9f823c8393ee tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:14.189380 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-00e5fb87-4e92-487c-bc9e-9f823c8393ee tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:14.195951 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-00e5fb87-4e92-487c-bc9e-9f823c8393ee tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:14.521939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c1130a19-e410-4dd9-88b7-403af4e5ffc1 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:14.524152 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c1130a19-e410-4dd9-88b7-403af4e5ffc1 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:14.538397 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c1130a19-e410-4dd9-88b7-403af4e5ffc1 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:14.539119 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c1130a19-e410-4dd9-88b7-403af4e5ffc1 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:14.540369 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c1130a19-e410-4dd9-88b7-403af4e5ffc1 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:14.541051 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c1130a19-e410-4dd9-88b7-403af4e5ffc1 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:14.561394 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-00e5fb87-4e92-487c-bc9e-9f823c8393ee tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:14.571529 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-00e5fb87-4e92-487c-bc9e-9f823c8393ee tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:14.576454 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-00e5fb87-4e92-487c-bc9e-9f823c8393ee tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:14.578055 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-00e5fb87-4e92-487c-bc9e-9f823c8393ee tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1737 microversion: 2.20 time: 0.411000 May 16 18:55:14.579159 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 415/825] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:14 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1737 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:14.822611 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c1130a19-e410-4dd9-88b7-403af4e5ffc1 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:14.837324 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c1130a19-e410-4dd9-88b7-403af4e5ffc1 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.346684 May 16 18:55:14.855380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 411/826] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:14 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:15.192307 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-c63ef790-b558-40ed-b5fc-56c151cc9bdc req-8b0d9ddf-ab1a-4749-bb48-c706685a76b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e5af044-6215-4872-8d22-7da21c796f5d", "tag": "05c357f9-475e-4afa-b068-1499c20820a7"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:15.219521 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-c63ef790-b558-40ed-b5fc-56c151cc9bdc req-8b0d9ddf-ab1a-4749-bb48-c706685a76b7 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:15.220421 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-c63ef790-b558-40ed-b5fc-56c151cc9bdc req-8b0d9ddf-ab1a-4749-bb48-c706685a76b7 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:15.249477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-c63ef790-b558-40ed-b5fc-56c151cc9bdc req-8b0d9ddf-ab1a-4749-bb48-c706685a76b7 service nova] Creating event network-changed:05c357f9-475e-4afa-b068-1499c20820a7 for instance 9e5af044-6215-4872-8d22-7da21c796f5d on hv-cinder-75078 May 16 18:55:15.255437 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-c63ef790-b558-40ed-b5fc-56c151cc9bdc req-8b0d9ddf-ab1a-4749-bb48-c706685a76b7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068388 May 16 18:55:15.260147 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 416/827] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:55:15.597767 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-cb4078b3-1dff-4a42-bad2-1d8b26667e6d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:15.599135 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-cb4078b3-1dff-4a42-bad2-1d8b26667e6d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:15.609865 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cb4078b3-1dff-4a42-bad2-1d8b26667e6d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:15.611205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cb4078b3-1dff-4a42-bad2-1d8b26667e6d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:15.612177 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cb4078b3-1dff-4a42-bad2-1d8b26667e6d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:15.612846 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-cb4078b3-1dff-4a42-bad2-1d8b26667e6d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:15.876016 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0fc10fa5-52c9-4f37-895e-8eda1a579495 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:15.877578 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0fc10fa5-52c9-4f37-895e-8eda1a579495 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:15.896753 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0fc10fa5-52c9-4f37-895e-8eda1a579495 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:15.897699 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0fc10fa5-52c9-4f37-895e-8eda1a579495 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:15.898879 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0fc10fa5-52c9-4f37-895e-8eda1a579495 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:15.899523 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0fc10fa5-52c9-4f37-895e-8eda1a579495 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:15.907004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-cb4078b3-1dff-4a42-bad2-1d8b26667e6d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:15.933355 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-cb4078b3-1dff-4a42-bad2-1d8b26667e6d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:15.943487 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-cb4078b3-1dff-4a42-bad2-1d8b26667e6d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:15.947542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-cb4078b3-1dff-4a42-bad2-1d8b26667e6d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1737 microversion: 2.20 time: 0.353703 May 16 18:55:15.952836 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 412/828] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:15 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1737 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:16.164858 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0fc10fa5-52c9-4f37-895e-8eda1a579495 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:16.178579 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0fc10fa5-52c9-4f37-895e-8eda1a579495 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.317498 May 16 18:55:16.179296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 417/829] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:15 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:16.973438 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c787f706-7198-43be-b050-ab72a2350c11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:16.978645 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c787f706-7198-43be-b050-ab72a2350c11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:16.993241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c787f706-7198-43be-b050-ab72a2350c11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:16.993993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c787f706-7198-43be-b050-ab72a2350c11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:16.994966 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c787f706-7198-43be-b050-ab72a2350c11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:16.995588 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c787f706-7198-43be-b050-ab72a2350c11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:17.218028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-169466c2-747e-405a-b613-cba5ec6cf35d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:17.220397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-169466c2-747e-405a-b613-cba5ec6cf35d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:17.237109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-169466c2-747e-405a-b613-cba5ec6cf35d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:17.238410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-169466c2-747e-405a-b613-cba5ec6cf35d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:17.240199 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-169466c2-747e-405a-b613-cba5ec6cf35d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:17.240968 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-169466c2-747e-405a-b613-cba5ec6cf35d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:17.284005 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c787f706-7198-43be-b050-ab72a2350c11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:17.292555 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c787f706-7198-43be-b050-ab72a2350c11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:17.294056 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c787f706-7198-43be-b050-ab72a2350c11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:17.295267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c787f706-7198-43be-b050-ab72a2350c11 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1737 microversion: 2.20 time: 0.326179 May 16 18:55:17.296214 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 413/830] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:16 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1737 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:17.480232 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-169466c2-747e-405a-b613-cba5ec6cf35d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:17.494228 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-169466c2-747e-405a-b613-cba5ec6cf35d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.284677 May 16 18:55:17.497680 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 418/831] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:17 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:18.319725 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c40edc36-c3f7-4210-bfc9-b5fc1e5da511 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:18.321324 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c40edc36-c3f7-4210-bfc9-b5fc1e5da511 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:18.333990 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c40edc36-c3f7-4210-bfc9-b5fc1e5da511 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:18.335441 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c40edc36-c3f7-4210-bfc9-b5fc1e5da511 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:18.336334 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c40edc36-c3f7-4210-bfc9-b5fc1e5da511 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:18.337117 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c40edc36-c3f7-4210-bfc9-b5fc1e5da511 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:18.526722 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0b42ba90-3ea6-4f1c-b875-b8c0e85e2397 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:18.527990 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0b42ba90-3ea6-4f1c-b875-b8c0e85e2397 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:18.540759 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0b42ba90-3ea6-4f1c-b875-b8c0e85e2397 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:18.541602 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0b42ba90-3ea6-4f1c-b875-b8c0e85e2397 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:18.542628 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0b42ba90-3ea6-4f1c-b875-b8c0e85e2397 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:18.543134 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0b42ba90-3ea6-4f1c-b875-b8c0e85e2397 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:18.576332 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c40edc36-c3f7-4210-bfc9-b5fc1e5da511 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:18.598126 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c40edc36-c3f7-4210-bfc9-b5fc1e5da511 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:18.599643 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c40edc36-c3f7-4210-bfc9-b5fc1e5da511 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:18.600999 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c40edc36-c3f7-4210-bfc9-b5fc1e5da511 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1737 microversion: 2.20 time: 0.286302 May 16 18:55:18.604078 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 414/832] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:18 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1737 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:18.743078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0b42ba90-3ea6-4f1c-b875-b8c0e85e2397 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:18.755467 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0b42ba90-3ea6-4f1c-b875-b8c0e85e2397 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.235073 May 16 18:55:18.756095 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 419/833] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:18 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:19.622426 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e29a7431-ccba-41a5-b991-e7fa210fa745 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:19.624663 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e29a7431-ccba-41a5-b991-e7fa210fa745 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:19.656344 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e29a7431-ccba-41a5-b991-e7fa210fa745 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:19.658811 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e29a7431-ccba-41a5-b991-e7fa210fa745 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:19.660416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e29a7431-ccba-41a5-b991-e7fa210fa745 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:19.661101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e29a7431-ccba-41a5-b991-e7fa210fa745 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:19.785993 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bfa722b8-2728-448c-bf63-fb9ec95e0bf6 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:19.788695 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-bfa722b8-2728-448c-bf63-fb9ec95e0bf6 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:19.804628 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bfa722b8-2728-448c-bf63-fb9ec95e0bf6 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:19.805483 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bfa722b8-2728-448c-bf63-fb9ec95e0bf6 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:19.808052 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bfa722b8-2728-448c-bf63-fb9ec95e0bf6 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:19.809069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bfa722b8-2728-448c-bf63-fb9ec95e0bf6 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:19.947332 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e29a7431-ccba-41a5-b991-e7fa210fa745 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:19.963625 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e29a7431-ccba-41a5-b991-e7fa210fa745 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:19.965406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e29a7431-ccba-41a5-b991-e7fa210fa745 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:19.967257 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e29a7431-ccba-41a5-b991-e7fa210fa745 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1737 microversion: 2.20 time: 0.350933 May 16 18:55:19.983701 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 415/834] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:19 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1737 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:20.032926 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bfa722b8-2728-448c-bf63-fb9ec95e0bf6 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:20.042724 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-bfa722b8-2728-448c-bf63-fb9ec95e0bf6 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.263341 May 16 18:55:20.043418 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 420/835] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:19 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:20.755676 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-413afc87-a4d7-49f1-9039-6d22bc6f0d3d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:20.756595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-413afc87-a4d7-49f1-9039-6d22bc6f0d3d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:20.764740 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-413afc87-a4d7-49f1-9039-6d22bc6f0d3d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:20.765187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-413afc87-a4d7-49f1-9039-6d22bc6f0d3d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:20.766027 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-413afc87-a4d7-49f1-9039-6d22bc6f0d3d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:20.766473 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-413afc87-a4d7-49f1-9039-6d22bc6f0d3d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:20.895312 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-413afc87-a4d7-49f1-9039-6d22bc6f0d3d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lazy-loading 'services' on Instance uuid 08296f7c-a2cd-4a66-9f47-ae72714a4e37 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:55:20.998270 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-16ce9cf5-228a-4700-8c9d-a0125d8b7843 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:21.000423 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-16ce9cf5-228a-4700-8c9d-a0125d8b7843 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:21.014513 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-413afc87-a4d7-49f1-9039-6d22bc6f0d3d tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "DELETE /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments/e3eaad5d-41ba-42c3-ae6a-8002e0295e56" status: 202 len: 0 microversion: 2.1 time: 0.261407 May 16 18:55:21.014513 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 416/836] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 18:55:20 2022] DELETE /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments/e3eaad5d-41ba-42c3-ae6a-8002e0295e56 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:55:21.026031 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f567df6b-6e4e-4c12-8df5-19db0bb97054 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:21.027881 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f567df6b-6e4e-4c12-8df5-19db0bb97054 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:21.028699 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16ce9cf5-228a-4700-8c9d-a0125d8b7843 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:21.029866 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16ce9cf5-228a-4700-8c9d-a0125d8b7843 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:21.032625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16ce9cf5-228a-4700-8c9d-a0125d8b7843 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:21.033787 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16ce9cf5-228a-4700-8c9d-a0125d8b7843 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:21.039118 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f567df6b-6e4e-4c12-8df5-19db0bb97054 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:21.039915 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f567df6b-6e4e-4c12-8df5-19db0bb97054 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:21.041451 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f567df6b-6e4e-4c12-8df5-19db0bb97054 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:21.042197 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f567df6b-6e4e-4c12-8df5-19db0bb97054 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:21.118994 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f567df6b-6e4e-4c12-8df5-19db0bb97054 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100398 May 16 18:55:21.120442 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 417/837] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:55:21 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:21.139417 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f55a80aa-c1eb-4f39-8358-3b00ebd8184b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:21.140952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f55a80aa-c1eb-4f39-8358-3b00ebd8184b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:21.161441 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f55a80aa-c1eb-4f39-8358-3b00ebd8184b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:21.163101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f55a80aa-c1eb-4f39-8358-3b00ebd8184b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:21.164964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f55a80aa-c1eb-4f39-8358-3b00ebd8184b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:21.166259 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f55a80aa-c1eb-4f39-8358-3b00ebd8184b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:21.452475 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-16ce9cf5-228a-4700-8c9d-a0125d8b7843 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:21.466408 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-16ce9cf5-228a-4700-8c9d-a0125d8b7843 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:21.468340 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-16ce9cf5-228a-4700-8c9d-a0125d8b7843 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:21.469763 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-16ce9cf5-228a-4700-8c9d-a0125d8b7843 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1737 microversion: 2.20 time: 0.482740 May 16 18:55:21.482222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f55a80aa-c1eb-4f39-8358-3b00ebd8184b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:21.483602 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 421/838] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:20 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1737 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:21.497538 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f55a80aa-c1eb-4f39-8358-3b00ebd8184b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.375495 May 16 18:55:21.512035 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 418/839] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:21 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:22.133684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1642cedd-8234-4254-9505-53c3b490f2de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:22.134623 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1642cedd-8234-4254-9505-53c3b490f2de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:22.141391 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1642cedd-8234-4254-9505-53c3b490f2de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:22.141845 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1642cedd-8234-4254-9505-53c3b490f2de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:22.142617 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1642cedd-8234-4254-9505-53c3b490f2de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:22.143048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1642cedd-8234-4254-9505-53c3b490f2de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:22.176818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1642cedd-8234-4254-9505-53c3b490f2de tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047144 May 16 18:55:22.177459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 422/840] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:55:22 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:55:22.490127 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-62469949-623c-4183-98ca-c0942e9767d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:22.490989 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-62469949-623c-4183-98ca-c0942e9767d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:22.497616 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-62469949-623c-4183-98ca-c0942e9767d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:22.498073 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-62469949-623c-4183-98ca-c0942e9767d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:22.498853 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-62469949-623c-4183-98ca-c0942e9767d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:22.499298 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-62469949-623c-4183-98ca-c0942e9767d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:22.524277 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-363929ba-ed07-4cbc-8951-6c73ccfb13e2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:22.524900 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-363929ba-ed07-4cbc-8951-6c73ccfb13e2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:22.531682 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-363929ba-ed07-4cbc-8951-6c73ccfb13e2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:22.532163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-363929ba-ed07-4cbc-8951-6c73ccfb13e2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:22.532958 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-363929ba-ed07-4cbc-8951-6c73ccfb13e2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:22.533900 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-363929ba-ed07-4cbc-8951-6c73ccfb13e2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:22.974209 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-62469949-623c-4183-98ca-c0942e9767d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:22.987313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-62469949-623c-4183-98ca-c0942e9767d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:22.989211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-363929ba-ed07-4cbc-8951-6c73ccfb13e2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:22.989834 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-62469949-623c-4183-98ca-c0942e9767d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:22.992587 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-62469949-623c-4183-98ca-c0942e9767d2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1737 microversion: 2.20 time: 0.506238 May 16 18:55:22.993391 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 419/841] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:22 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1737 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:23.006100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-363929ba-ed07-4cbc-8951-6c73ccfb13e2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.484186 May 16 18:55:23.006100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 423/842] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:22 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:23.192518 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1f727bba-22ee-4698-9fb4-4e0a8bee35ac tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:23.193653 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1f727bba-22ee-4698-9fb4-4e0a8bee35ac tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:23.203171 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1f727bba-22ee-4698-9fb4-4e0a8bee35ac tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:23.203692 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1f727bba-22ee-4698-9fb4-4e0a8bee35ac tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:23.205046 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1f727bba-22ee-4698-9fb4-4e0a8bee35ac tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:23.205798 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1f727bba-22ee-4698-9fb4-4e0a8bee35ac tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:23.244835 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1f727bba-22ee-4698-9fb4-4e0a8bee35ac tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059170 May 16 18:55:23.245734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 420/843] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:55:23 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:24.015072 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-157c5339-b57e-4789-af22-fd5be7d687c9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:24.016511 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-157c5339-b57e-4789-af22-fd5be7d687c9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:24.024558 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-157c5339-b57e-4789-af22-fd5be7d687c9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:24.025007 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-157c5339-b57e-4789-af22-fd5be7d687c9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:24.025791 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-157c5339-b57e-4789-af22-fd5be7d687c9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:24.026383 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-157c5339-b57e-4789-af22-fd5be7d687c9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:24.027134 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b33f9c88-fe6b-4894-b845-fdbd0574cc7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:24.027788 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b33f9c88-fe6b-4894-b845-fdbd0574cc7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:24.036490 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b33f9c88-fe6b-4894-b845-fdbd0574cc7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:24.037308 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b33f9c88-fe6b-4894-b845-fdbd0574cc7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:24.038820 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b33f9c88-fe6b-4894-b845-fdbd0574cc7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:24.039489 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b33f9c88-fe6b-4894-b845-fdbd0574cc7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:24.245551 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-157c5339-b57e-4789-af22-fd5be7d687c9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:24.255199 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b33f9c88-fe6b-4894-b845-fdbd0574cc7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:24.255648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-157c5339-b57e-4789-af22-fd5be7d687c9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:24.257229 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-157c5339-b57e-4789-af22-fd5be7d687c9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:24.258438 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-157c5339-b57e-4789-af22-fd5be7d687c9 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1719 microversion: 2.20 time: 0.247643 May 16 18:55:24.259006 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 424/844] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:24 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1719 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:24.263797 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c4b4cf58-cf74-4f99-ae02-332c0a95aa22 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:24.264726 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c4b4cf58-cf74-4f99-ae02-332c0a95aa22 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:24.268034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b33f9c88-fe6b-4894-b845-fdbd0574cc7e tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.244562 May 16 18:55:24.269784 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 421/845] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:24 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:24.271566 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c4b4cf58-cf74-4f99-ae02-332c0a95aa22 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:24.272126 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c4b4cf58-cf74-4f99-ae02-332c0a95aa22 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:24.274089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c4b4cf58-cf74-4f99-ae02-332c0a95aa22 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:24.274580 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c4b4cf58-cf74-4f99-ae02-332c0a95aa22 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:24.308687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c4b4cf58-cf74-4f99-ae02-332c0a95aa22 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048609 May 16 18:55:24.309279 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 425/846] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:55:24 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 18:55:24.408920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-245567f8-a7af-4917-a2b7-848ad551d7b9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:24.409491 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-245567f8-a7af-4917-a2b7-848ad551d7b9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:24.418509 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-245567f8-a7af-4917-a2b7-848ad551d7b9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:24.418966 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-245567f8-a7af-4917-a2b7-848ad551d7b9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:24.419809 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-245567f8-a7af-4917-a2b7-848ad551d7b9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:24.420248 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-245567f8-a7af-4917-a2b7-848ad551d7b9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:24.451295 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-245567f8-a7af-4917-a2b7-848ad551d7b9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:55:24.556743 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-245567f8-a7af-4917-a2b7-848ad551d7b9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "DELETE /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 204 len: 0 microversion: 2.1 time: 0.152541 May 16 18:55:24.557824 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 422/847] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:55:24 2022] DELETE /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:55:24.572301 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d2b61f0c-6be3-46e4-b28a-a30a64f49e32 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:24.572717 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d2b61f0c-6be3-46e4-b28a-a30a64f49e32 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:24.578871 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2b61f0c-6be3-46e4-b28a-a30a64f49e32 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:24.579326 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2b61f0c-6be3-46e4-b28a-a30a64f49e32 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:24.580180 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2b61f0c-6be3-46e4-b28a-a30a64f49e32 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:24.580621 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2b61f0c-6be3-46e4-b28a-a30a64f49e32 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:24.733474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d2b61f0c-6be3-46e4-b28a-a30a64f49e32 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:24.741841 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d2b61f0c-6be3-46e4-b28a-a30a64f49e32 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1688 microversion: 2.1 time: 0.177143 May 16 18:55:24.742776 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 426/848] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:24 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:25.278754 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a0daed00-b1e0-4f69-8791-5c683ed3f6fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:25.279563 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a0daed00-b1e0-4f69-8791-5c683ed3f6fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:25.287040 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0daed00-b1e0-4f69-8791-5c683ed3f6fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:25.288228 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0daed00-b1e0-4f69-8791-5c683ed3f6fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:25.289232 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0daed00-b1e0-4f69-8791-5c683ed3f6fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:25.289676 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0daed00-b1e0-4f69-8791-5c683ed3f6fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:25.294489 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ef651afd-52b4-448c-8832-0f14cac947d2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:25.295234 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ef651afd-52b4-448c-8832-0f14cac947d2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:25.305196 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ef651afd-52b4-448c-8832-0f14cac947d2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:25.305913 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ef651afd-52b4-448c-8832-0f14cac947d2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:25.307109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ef651afd-52b4-448c-8832-0f14cac947d2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:25.307768 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ef651afd-52b4-448c-8832-0f14cac947d2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:25.521312 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a0daed00-b1e0-4f69-8791-5c683ed3f6fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:25.528875 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ef651afd-52b4-448c-8832-0f14cac947d2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:25.531252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a0daed00-b1e0-4f69-8791-5c683ed3f6fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:25.532866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a0daed00-b1e0-4f69-8791-5c683ed3f6fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:25.534111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a0daed00-b1e0-4f69-8791-5c683ed3f6fe tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1719 microversion: 2.20 time: 0.259919 May 16 18:55:25.534701 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 423/849] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:25 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1719 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:25.540950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ef651afd-52b4-448c-8832-0f14cac947d2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.251697 May 16 18:55:25.541941 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 427/850] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:25 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:25.762038 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-61fac1de-084b-4572-9eb1-d7fdd9f5534c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:25.762689 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-61fac1de-084b-4572-9eb1-d7fdd9f5534c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:25.772005 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-61fac1de-084b-4572-9eb1-d7fdd9f5534c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:25.772788 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-61fac1de-084b-4572-9eb1-d7fdd9f5534c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:25.773810 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-61fac1de-084b-4572-9eb1-d7fdd9f5534c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:25.774288 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-61fac1de-084b-4572-9eb1-d7fdd9f5534c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:25.928839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-61fac1de-084b-4572-9eb1-d7fdd9f5534c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:25.939257 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-61fac1de-084b-4572-9eb1-d7fdd9f5534c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1688 microversion: 2.1 time: 0.180724 May 16 18:55:25.940012 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 424/851] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:25 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:26.555744 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7c35c26e-53d1-4045-9d8a-185457ddc778 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:26.556391 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7c35c26e-53d1-4045-9d8a-185457ddc778 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:26.563206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ca4331ec-6138-42ce-941f-0623aa5d84fa tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:26.564023 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c35c26e-53d1-4045-9d8a-185457ddc778 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:26.564023 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c35c26e-53d1-4045-9d8a-185457ddc778 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:26.564713 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c35c26e-53d1-4045-9d8a-185457ddc778 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:26.565150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c35c26e-53d1-4045-9d8a-185457ddc778 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:26.565416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ca4331ec-6138-42ce-941f-0623aa5d84fa tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:26.573237 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ca4331ec-6138-42ce-941f-0623aa5d84fa tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:26.573680 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ca4331ec-6138-42ce-941f-0623aa5d84fa tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:26.574470 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ca4331ec-6138-42ce-941f-0623aa5d84fa tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:26.575140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ca4331ec-6138-42ce-941f-0623aa5d84fa tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:26.791223 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7c35c26e-53d1-4045-9d8a-185457ddc778 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:26.802705 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ca4331ec-6138-42ce-941f-0623aa5d84fa tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:26.807412 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7c35c26e-53d1-4045-9d8a-185457ddc778 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:26.810489 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7c35c26e-53d1-4045-9d8a-185457ddc778 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:26.812274 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ca4331ec-6138-42ce-941f-0623aa5d84fa tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.253325 May 16 18:55:26.812441 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7c35c26e-53d1-4045-9d8a-185457ddc778 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1719 microversion: 2.20 time: 0.261686 May 16 18:55:26.812856 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 425/852] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:26 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:26.817862 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-028ba95f-2fc6-4f1a-82b1-2a7466f46ccd req-5e10bad5-dda5-4b1b-8e7e-7e1a5266f976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e5af044-6215-4872-8d22-7da21c796f5d", "name": "network-vif-plugged", "status": "completed", "tag": "05c357f9-475e-4afa-b068-1499c20820a7"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:26.828831 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 428/853] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:26 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1719 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:26.838259 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-028ba95f-2fc6-4f1a-82b1-2a7466f46ccd req-5e10bad5-dda5-4b1b-8e7e-7e1a5266f976 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:26.838740 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-028ba95f-2fc6-4f1a-82b1-2a7466f46ccd req-5e10bad5-dda5-4b1b-8e7e-7e1a5266f976 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:26.851238 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-028ba95f-2fc6-4f1a-82b1-2a7466f46ccd req-5e10bad5-dda5-4b1b-8e7e-7e1a5266f976 service nova] Creating event network-vif-plugged:05c357f9-475e-4afa-b068-1499c20820a7 for instance 9e5af044-6215-4872-8d22-7da21c796f5d on hv-cinder-75078 May 16 18:55:26.856433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-028ba95f-2fc6-4f1a-82b1-2a7466f46ccd req-5e10bad5-dda5-4b1b-8e7e-7e1a5266f976 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042174 May 16 18:55:26.857152 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 426/854] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:26.962139 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-00dd65f5-35d2-4406-bf7b-3dd930a4207a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:26.962807 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-00dd65f5-35d2-4406-bf7b-3dd930a4207a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:26.969285 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-00dd65f5-35d2-4406-bf7b-3dd930a4207a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:26.969785 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-00dd65f5-35d2-4406-bf7b-3dd930a4207a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:26.970589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-00dd65f5-35d2-4406-bf7b-3dd930a4207a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:26.971021 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-00dd65f5-35d2-4406-bf7b-3dd930a4207a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:27.125028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-00dd65f5-35d2-4406-bf7b-3dd930a4207a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:27.133567 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-00dd65f5-35d2-4406-bf7b-3dd930a4207a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1688 microversion: 2.1 time: 0.175521 May 16 18:55:27.134162 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 429/855] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:26 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:27.841984 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-dde9164b-c4bf-4782-8bf8-2598c825e636 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:27.842980 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-dde9164b-c4bf-4782-8bf8-2598c825e636 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:27.848223 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f72a9ad7-00c5-46dd-b0c1-157e15b897d5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:27.848833 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f72a9ad7-00c5-46dd-b0c1-157e15b897d5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:27.853441 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dde9164b-c4bf-4782-8bf8-2598c825e636 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:27.854155 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dde9164b-c4bf-4782-8bf8-2598c825e636 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:27.855156 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dde9164b-c4bf-4782-8bf8-2598c825e636 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:27.855593 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-dde9164b-c4bf-4782-8bf8-2598c825e636 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:27.856361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f72a9ad7-00c5-46dd-b0c1-157e15b897d5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:27.856810 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f72a9ad7-00c5-46dd-b0c1-157e15b897d5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:27.857597 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f72a9ad7-00c5-46dd-b0c1-157e15b897d5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:27.858034 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f72a9ad7-00c5-46dd-b0c1-157e15b897d5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:28.072101 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f72a9ad7-00c5-46dd-b0c1-157e15b897d5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:28.080415 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-dde9164b-c4bf-4782-8bf8-2598c825e636 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:28.081671 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f72a9ad7-00c5-46dd-b0c1-157e15b897d5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:28.083586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f72a9ad7-00c5-46dd-b0c1-157e15b897d5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:28.085536 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f72a9ad7-00c5-46dd-b0c1-157e15b897d5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1719 microversion: 2.20 time: 0.241034 May 16 18:55:28.085920 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 430/856] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:27 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1719 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:28.091659 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-dde9164b-c4bf-4782-8bf8-2598c825e636 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.257638 May 16 18:55:28.092987 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 427/857] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:27 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:28.155521 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-16aebc3f-cb2c-4257-baae-04d2432516f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:28.156161 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-16aebc3f-cb2c-4257-baae-04d2432516f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:28.162545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16aebc3f-cb2c-4257-baae-04d2432516f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:28.163054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16aebc3f-cb2c-4257-baae-04d2432516f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:28.163971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16aebc3f-cb2c-4257-baae-04d2432516f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:28.164404 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16aebc3f-cb2c-4257-baae-04d2432516f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:28.329080 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-16aebc3f-cb2c-4257-baae-04d2432516f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:28.345116 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-16aebc3f-cb2c-4257-baae-04d2432516f0 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1688 microversion: 2.1 time: 0.196851 May 16 18:55:28.345780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 431/858] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:28 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:28.896493 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-8a5438ad-a97d-42e0-9240-4f32c22d9039 req-bf2e493e-9389-4b8d-ac80-a1aafbc7ee32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b2dd21-9b22-4230-8bee-d6f04f06019f", "name": "network-vif-unplugged", "status": "completed", "tag": "7c023405-87f2-4ed0-9c4c-c419d714714d"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:28.905498 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-8a5438ad-a97d-42e0-9240-4f32c22d9039 req-bf2e493e-9389-4b8d-ac80-a1aafbc7ee32 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:28.905938 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-8a5438ad-a97d-42e0-9240-4f32c22d9039 req-bf2e493e-9389-4b8d-ac80-a1aafbc7ee32 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:28.921973 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-8a5438ad-a97d-42e0-9240-4f32c22d9039 req-bf2e493e-9389-4b8d-ac80-a1aafbc7ee32 service nova] Creating event network-vif-unplugged:7c023405-87f2-4ed0-9c4c-c419d714714d for instance 86b2dd21-9b22-4230-8bee-d6f04f06019f on hv-cinder-75078 May 16 18:55:28.930357 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-8a5438ad-a97d-42e0-9240-4f32c22d9039 req-bf2e493e-9389-4b8d-ac80-a1aafbc7ee32 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037135 May 16 18:55:28.931326 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 428/859] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:55:29.106513 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d4528aad-7246-445c-9eb3-e82c0070109d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:29.109084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d4528aad-7246-445c-9eb3-e82c0070109d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:29.113414 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-74e95cb0-7395-4652-a8b7-143d9cae92f0 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:29.114585 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-74e95cb0-7395-4652-a8b7-143d9cae92f0 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:29.118756 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d4528aad-7246-445c-9eb3-e82c0070109d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:29.119304 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d4528aad-7246-445c-9eb3-e82c0070109d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:29.120232 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d4528aad-7246-445c-9eb3-e82c0070109d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:29.120749 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d4528aad-7246-445c-9eb3-e82c0070109d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:29.124737 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-74e95cb0-7395-4652-a8b7-143d9cae92f0 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:29.125435 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-74e95cb0-7395-4652-a8b7-143d9cae92f0 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:29.126652 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-74e95cb0-7395-4652-a8b7-143d9cae92f0 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:29.127348 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-74e95cb0-7395-4652-a8b7-143d9cae92f0 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:29.379408 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d4528aad-7246-445c-9eb3-e82c0070109d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:29.388603 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-74e95cb0-7395-4652-a8b7-143d9cae92f0 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:29.395657 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d4528aad-7246-445c-9eb3-e82c0070109d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:29.398654 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d4528aad-7246-445c-9eb3-e82c0070109d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:29.400458 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d4528aad-7246-445c-9eb3-e82c0070109d tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1719 microversion: 2.20 time: 0.299721 May 16 18:55:29.401039 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 432/860] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:29 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1719 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:29.404528 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-74e95cb0-7395-4652-a8b7-143d9cae92f0 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.295006 May 16 18:55:29.408347 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a78ae314-2811-4684-ba03-2fa4cc1d3efc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:29.409743 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a78ae314-2811-4684-ba03-2fa4cc1d3efc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:29.416506 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 429/861] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:29 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:29.425577 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a78ae314-2811-4684-ba03-2fa4cc1d3efc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:29.426222 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a78ae314-2811-4684-ba03-2fa4cc1d3efc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:29.427313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a78ae314-2811-4684-ba03-2fa4cc1d3efc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:29.428164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a78ae314-2811-4684-ba03-2fa4cc1d3efc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:29.597920 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a78ae314-2811-4684-ba03-2fa4cc1d3efc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:29.608121 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a78ae314-2811-4684-ba03-2fa4cc1d3efc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1688 microversion: 2.1 time: 0.205763 May 16 18:55:29.608787 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 433/862] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:29 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1688 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:30.427401 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e82280d7-b777-4411-8b18-fd34a116b0c6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:30.429970 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e82280d7-b777-4411-8b18-fd34a116b0c6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:30.431078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b59b52b8-90de-4032-a01b-54f54950f4dc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:30.431698 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b59b52b8-90de-4032-a01b-54f54950f4dc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:30.439273 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e82280d7-b777-4411-8b18-fd34a116b0c6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:30.440320 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e82280d7-b777-4411-8b18-fd34a116b0c6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:30.442007 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e82280d7-b777-4411-8b18-fd34a116b0c6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:30.442890 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e82280d7-b777-4411-8b18-fd34a116b0c6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:30.448048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b59b52b8-90de-4032-a01b-54f54950f4dc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:30.449238 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b59b52b8-90de-4032-a01b-54f54950f4dc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:30.450859 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b59b52b8-90de-4032-a01b-54f54950f4dc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:30.451807 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b59b52b8-90de-4032-a01b-54f54950f4dc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:30.724459 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e82280d7-b777-4411-8b18-fd34a116b0c6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:30.735041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e82280d7-b777-4411-8b18-fd34a116b0c6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:30.737178 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e82280d7-b777-4411-8b18-fd34a116b0c6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:30.738603 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e82280d7-b777-4411-8b18-fd34a116b0c6 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1722 microversion: 2.20 time: 0.319901 May 16 18:55:30.739297 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 430/863] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:30 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:30.739983 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b59b52b8-90de-4032-a01b-54f54950f4dc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:30.749327 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b59b52b8-90de-4032-a01b-54f54950f4dc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.323974 May 16 18:55:30.749872 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6bcc7f67-7131-4a5c-bcb5-ebeb70c5d33f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:30.750343 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 434/864] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:30 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:30.751003 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6bcc7f67-7131-4a5c-bcb5-ebeb70c5d33f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:30.761515 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6bcc7f67-7131-4a5c-bcb5-ebeb70c5d33f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:30.762380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6bcc7f67-7131-4a5c-bcb5-ebeb70c5d33f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:30.763644 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6bcc7f67-7131-4a5c-bcb5-ebeb70c5d33f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:30.764270 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6bcc7f67-7131-4a5c-bcb5-ebeb70c5d33f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:30.769140 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0dcb0f1f-eff1-4f10-9f08-33cce8d86e5c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fdf0eef-c46c-428f-99bd-e9134e0dc5b0"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:30.770393 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0dcb0f1f-eff1-4f10-9f08-33cce8d86e5c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:30.780006 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0dcb0f1f-eff1-4f10-9f08-33cce8d86e5c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:30.780630 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0dcb0f1f-eff1-4f10-9f08-33cce8d86e5c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:30.781557 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0dcb0f1f-eff1-4f10-9f08-33cce8d86e5c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:30.782203 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0dcb0f1f-eff1-4f10-9f08-33cce8d86e5c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:31.063349 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6bcc7f67-7131-4a5c-bcb5-ebeb70c5d33f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:31.072710 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6bcc7f67-7131-4a5c-bcb5-ebeb70c5d33f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1688 microversion: 2.1 time: 0.331936 May 16 18:55:31.073425 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 431/865] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:30 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1688 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:31.186196 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0dcb0f1f-eff1-4f10-9f08-33cce8d86e5c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "POST /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.421081 May 16 18:55:31.192573 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 435/866] 10.222.0.72 () {62 vars in 1363 bytes} [Mon May 16 18:55:30 2022] POST /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/os-volume_attachments => generated 188 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 18:55:31.337607 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7e598977-5c27-4580-acc8-ec8b33d71f83 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:31.338393 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7e598977-5c27-4580-acc8-ec8b33d71f83 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:31.348304 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7e598977-5c27-4580-acc8-ec8b33d71f83 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:31.349070 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7e598977-5c27-4580-acc8-ec8b33d71f83 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:31.350380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7e598977-5c27-4580-acc8-ec8b33d71f83 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:31.351107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7e598977-5c27-4580-acc8-ec8b33d71f83 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:31.661929 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7e598977-5c27-4580-acc8-ec8b33d71f83 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "DELETE /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/os-volume_attachments/3fdf0eef-c46c-428f-99bd-e9134e0dc5b0" status: 202 len: 0 microversion: 2.20 time: 0.331361 May 16 18:55:31.663834 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 432/867] 10.222.0.72 () {60 vars in 1456 bytes} [Mon May 16 18:55:31 2022] DELETE /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/os-volume_attachments/3fdf0eef-c46c-428f-99bd-e9134e0dc5b0 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 18:55:31.745610 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d734459d-d8a8-49b8-a23c-e2aa51f61369 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:31.746675 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d734459d-d8a8-49b8-a23c-e2aa51f61369 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:31.753356 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d734459d-d8a8-49b8-a23c-e2aa51f61369 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:31.753810 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d734459d-d8a8-49b8-a23c-e2aa51f61369 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:31.754596 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d734459d-d8a8-49b8-a23c-e2aa51f61369 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:31.755047 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d734459d-d8a8-49b8-a23c-e2aa51f61369 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:31.768608 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8e203270-8f87-41df-8d70-32d1095fcb4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:31.769508 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8e203270-8f87-41df-8d70-32d1095fcb4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:31.777454 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e203270-8f87-41df-8d70-32d1095fcb4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:31.778378 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e203270-8f87-41df-8d70-32d1095fcb4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:31.780038 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e203270-8f87-41df-8d70-32d1095fcb4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:31.781080 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8e203270-8f87-41df-8d70-32d1095fcb4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:31.870012 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d734459d-d8a8-49b8-a23c-e2aa51f61369 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "POST /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/action" status: 202 len: 0 microversion: 2.20 time: 0.129873 May 16 18:55:31.871265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 436/868] 10.222.0.72 () {62 vars in 1318 bytes} [Mon May 16 18:55:31 2022] POST /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 18:55:31.891780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-35097b58-705b-4888-98b6-9283023ef708 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:31.892418 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-35097b58-705b-4888-98b6-9283023ef708 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:31.899896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35097b58-705b-4888-98b6-9283023ef708 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:31.900363 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35097b58-705b-4888-98b6-9283023ef708 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:31.901224 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35097b58-705b-4888-98b6-9283023ef708 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:31.901711 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35097b58-705b-4888-98b6-9283023ef708 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:32.152099 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8e203270-8f87-41df-8d70-32d1095fcb4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:32.160046 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8e203270-8f87-41df-8d70-32d1095fcb4a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1265 microversion: 2.1 time: 0.396940 May 16 18:55:32.161420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 433/869] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:31 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:32.172746 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-fc022af1-b253-4db3-8b75-3bf96f8fa9bd req-30990f85-b2ab-4d24-95a3-daec5b96db0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08296f7c-a2cd-4a66-9f47-ae72714a4e37", "name": "network-vif-deleted", "tag": "beee622c-240e-41d7-b32d-a07b68814889"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:32.200249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-fc022af1-b253-4db3-8b75-3bf96f8fa9bd req-30990f85-b2ab-4d24-95a3-daec5b96db0a service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:32.201111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-fc022af1-b253-4db3-8b75-3bf96f8fa9bd req-30990f85-b2ab-4d24-95a3-daec5b96db0a service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:32.234764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-35097b58-705b-4888-98b6-9283023ef708 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:32.238256 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-fc022af1-b253-4db3-8b75-3bf96f8fa9bd req-30990f85-b2ab-4d24-95a3-daec5b96db0a service nova] Creating event network-vif-deleted:beee622c-240e-41d7-b32d-a07b68814889 for instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 on hv-cinder-75078 May 16 18:55:32.244731 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-35097b58-705b-4888-98b6-9283023ef708 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:32.251862 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-35097b58-705b-4888-98b6-9283023ef708 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:32.253109 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-35097b58-705b-4888-98b6-9283023ef708 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1670 microversion: 2.20 time: 0.369602 May 16 18:55:32.253793 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 437/870] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:31 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1670 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:32.263024 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-fc022af1-b253-4db3-8b75-3bf96f8fa9bd req-30990f85-b2ab-4d24-95a3-daec5b96db0a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100511 May 16 18:55:32.264482 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 434/871] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:32.276171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:32.276692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:32.283353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:32.283952 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:32.284754 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:32.285204 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:32.353488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:32.353952 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:32.354428 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lazy-loading 'fault' on Instance uuid 08296f7c-a2cd-4a66-9f47-ae72714a4e37 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:55:32.417833 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:32.432353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b5e3be2e-a42b-4f0e-b0c0-a375977f648e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 200 len: 1335 microversion: 2.1 time: 0.161415 May 16 18:55:32.433345 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 438/872] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:32 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 1335 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:33.183053 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0f5b6338-6038-4f5e-9464-ff5bc4c1fe6d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:33.184443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0f5b6338-6038-4f5e-9464-ff5bc4c1fe6d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:33.200460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0f5b6338-6038-4f5e-9464-ff5bc4c1fe6d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:33.201452 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0f5b6338-6038-4f5e-9464-ff5bc4c1fe6d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:33.202819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0f5b6338-6038-4f5e-9464-ff5bc4c1fe6d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:33.203643 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0f5b6338-6038-4f5e-9464-ff5bc4c1fe6d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:33.275117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bebdfcc7-8220-4228-9faa-e911dbf94376 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:33.276019 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-bebdfcc7-8220-4228-9faa-e911dbf94376 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:33.284916 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bebdfcc7-8220-4228-9faa-e911dbf94376 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:33.285538 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bebdfcc7-8220-4228-9faa-e911dbf94376 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:33.286438 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bebdfcc7-8220-4228-9faa-e911dbf94376 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:33.286983 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bebdfcc7-8220-4228-9faa-e911dbf94376 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:33.486861 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0f5b6338-6038-4f5e-9464-ff5bc4c1fe6d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:33.506587 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0f5b6338-6038-4f5e-9464-ff5bc4c1fe6d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1452 microversion: 2.1 time: 0.331735 May 16 18:55:33.507200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 435/873] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:33 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1452 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:33.520904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6551cbc0-251a-4202-b3f4-409ead000e72 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:33.522342 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6551cbc0-251a-4202-b3f4-409ead000e72 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 08296f7c-a2cd-4a66-9f47-ae72714a4e37] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:33.529110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6551cbc0-251a-4202-b3f4-409ead000e72 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:33.529837 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6551cbc0-251a-4202-b3f4-409ead000e72 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:33.530795 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6551cbc0-251a-4202-b3f4-409ead000e72 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:33.531403 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6551cbc0-251a-4202-b3f4-409ead000e72 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:33.560167 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-6551cbc0-251a-4202-b3f4-409ead000e72 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] HTTP exception thrown: Instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 could not be found. May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6551cbc0-251a-4202-b3f4-409ead000e72 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Request method failure captured: May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 HTTP/1.1 May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpzg_Pwgwncj8s5c-vohUPtNAuGaR132lrZYw_aU8QzfdorNmdIes6ufMp_OpEpKC8RJG-tNmWB2qOSEHIYoYS2_ry6eMVKghmNBWXn50nOzP_tfjsnxTAesZPSPNnVmxEieajJZdqMpkVwbQctsn13iD0NMbnMI0cGFqADMHG_Pgqw May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 9fe0e3c0f5eb4d4199f084be233eb1d3 May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:55:33.570243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 9fe0e3c0f5eb4d4199f084be233eb1d3 May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-ServerRescueNegativeTestJSON-130323987-project May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 89539508b327427ba1a449fe30569606 May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-130323987-project May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 could not be found. May 16 18:55:33.571906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '08296f7c-a2cd-4a66-9f47-ae72714a4e37'} May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 could not be found. May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:55:33.572863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 could not be found. May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 could not be found. May 16 18:55:33.574544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:33.575999 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6551cbc0-251a-4202-b3f4-409ead000e72 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Returning 404 to user: Instance 08296f7c-a2cd-4a66-9f47-ae72714a4e37 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:55:33.575999 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6551cbc0-251a-4202-b3f4-409ead000e72 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37" status: 404 len: 111 microversion: 2.1 time: 0.059606 May 16 18:55:33.575999 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 436/874] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:33 2022] GET /compute/v2.1/servers/08296f7c-a2cd-4a66-9f47-ae72714a4e37 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:55:33.576226 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bebdfcc7-8220-4228-9faa-e911dbf94376 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:33.587350 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-95bb05c3-fba6-4e88-8c58-039161bf68fb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:33.588461 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-95bb05c3-fba6-4e88-8c58-039161bf68fb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:33.592095 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bebdfcc7-8220-4228-9faa-e911dbf94376 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:33.594771 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bebdfcc7-8220-4228-9faa-e911dbf94376 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:33.597452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-bebdfcc7-8220-4228-9faa-e911dbf94376 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1670 microversion: 2.20 time: 0.327603 May 16 18:55:33.598838 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 439/875] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:33 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1670 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:33.607513 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-dae1cc6d-0dd7-44a1-89cd-c4d099fd7bd9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '.version_select at 0x7f646cef0a60>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:33.616466 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95bb05c3-fba6-4e88-8c58-039161bf68fb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:33.617366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95bb05c3-fba6-4e88-8c58-039161bf68fb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:33.618399 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95bb05c3-fba6-4e88-8c58-039161bf68fb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:33.619042 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-95bb05c3-fba6-4e88-8c58-039161bf68fb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:33.638432 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-dae1cc6d-0dd7-44a1-89cd-c4d099fd7bd9 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705470101" status: 202 len: 0 microversion: 2.1 time: 0.037225 May 16 18:55:33.639420 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 440/876] 10.222.0.72 () {58 vars in 1217 bytes} [Mon May 16 18:55:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705470101 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:55:33.873089 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-95bb05c3-fba6-4e88-8c58-039161bf68fb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:33.885079 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-95bb05c3-fba6-4e88-8c58-039161bf68fb tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1452 microversion: 2.1 time: 0.310064 May 16 18:55:33.885819 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 437/877] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:33 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1452 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:34.636089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-cebe6fbc-bc2a-4053-ab17-5d9b4e95984a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:34.636876 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-cebe6fbc-bc2a-4053-ab17-5d9b4e95984a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:34.645620 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cebe6fbc-bc2a-4053-ab17-5d9b4e95984a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:34.646397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cebe6fbc-bc2a-4053-ab17-5d9b4e95984a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:34.648315 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cebe6fbc-bc2a-4053-ab17-5d9b4e95984a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:34.648963 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cebe6fbc-bc2a-4053-ab17-5d9b4e95984a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:34.933724 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cebe6fbc-bc2a-4053-ab17-5d9b4e95984a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:34.945741 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cebe6fbc-bc2a-4053-ab17-5d9b4e95984a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:34.948044 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-cebe6fbc-bc2a-4053-ab17-5d9b4e95984a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:34.950134 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-cebe6fbc-bc2a-4053-ab17-5d9b4e95984a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.322920 May 16 18:55:34.951244 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 441/878] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:34 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:35.988185 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7edd2079-0ab4-4150-a80b-89db1d0f03c3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:35.992049 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7edd2079-0ab4-4150-a80b-89db1d0f03c3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:36.008387 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7edd2079-0ab4-4150-a80b-89db1d0f03c3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:36.010067 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7edd2079-0ab4-4150-a80b-89db1d0f03c3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:36.012669 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7edd2079-0ab4-4150-a80b-89db1d0f03c3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:36.014317 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7edd2079-0ab4-4150-a80b-89db1d0f03c3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:36.374875 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7edd2079-0ab4-4150-a80b-89db1d0f03c3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:36.389547 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7edd2079-0ab4-4150-a80b-89db1d0f03c3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:36.392198 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-7edd2079-0ab4-4150-a80b-89db1d0f03c3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:36.394121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7edd2079-0ab4-4150-a80b-89db1d0f03c3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.416296 May 16 18:55:36.395203 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 438/879] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:35 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:36.697723 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-b791b053-e72a-4656-96ed-8b59479744e5 req-847690b8-b70c-4cd5-b2ca-7499e394284e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e5af044-6215-4872-8d22-7da21c796f5d", "tag": "05c357f9-475e-4afa-b068-1499c20820a7"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:36.719043 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-b791b053-e72a-4656-96ed-8b59479744e5 req-847690b8-b70c-4cd5-b2ca-7499e394284e service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:36.719849 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-b791b053-e72a-4656-96ed-8b59479744e5 req-847690b8-b70c-4cd5-b2ca-7499e394284e service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:36.743543 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-b791b053-e72a-4656-96ed-8b59479744e5 req-847690b8-b70c-4cd5-b2ca-7499e394284e service nova] Creating event network-changed:05c357f9-475e-4afa-b068-1499c20820a7 for instance 9e5af044-6215-4872-8d22-7da21c796f5d on hv-cinder-75078 May 16 18:55:36.752688 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-b791b053-e72a-4656-96ed-8b59479744e5 req-847690b8-b70c-4cd5-b2ca-7499e394284e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062753 May 16 18:55:36.754401 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 442/880] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:55:37.358003 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-966f3ba5-3718-4a38-81c8-7d33384c4692 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:37.359404 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-966f3ba5-3718-4a38-81c8-7d33384c4692 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:37.368366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-966f3ba5-3718-4a38-81c8-7d33384c4692 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:37.368962 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-966f3ba5-3718-4a38-81c8-7d33384c4692 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:37.369996 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-966f3ba5-3718-4a38-81c8-7d33384c4692 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:37.370479 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-966f3ba5-3718-4a38-81c8-7d33384c4692 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:37.398946 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-966f3ba5-3718-4a38-81c8-7d33384c4692 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:55:37.431200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f84243b3-3a22-4a2b-9800-7a62dc7da367 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:37.432236 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f84243b3-3a22-4a2b-9800-7a62dc7da367 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:37.455457 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f84243b3-3a22-4a2b-9800-7a62dc7da367 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:37.456213 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f84243b3-3a22-4a2b-9800-7a62dc7da367 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:37.457205 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f84243b3-3a22-4a2b-9800-7a62dc7da367 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:37.457821 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f84243b3-3a22-4a2b-9800-7a62dc7da367 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:37.616039 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-966f3ba5-3718-4a38-81c8-7d33384c4692 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 204 len: 0 microversion: 2.1 time: 0.261415 May 16 18:55:37.622359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 439/881] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:55:37 2022] DELETE /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 18:55:37.632146 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a0557aa2-1e4e-41f3-a6a0-e2fe4dd3a515 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:37.633503 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a0557aa2-1e4e-41f3-a6a0-e2fe4dd3a515 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:37.644789 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0557aa2-1e4e-41f3-a6a0-e2fe4dd3a515 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:37.646154 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0557aa2-1e4e-41f3-a6a0-e2fe4dd3a515 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:37.648045 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0557aa2-1e4e-41f3-a6a0-e2fe4dd3a515 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:37.649106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0557aa2-1e4e-41f3-a6a0-e2fe4dd3a515 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:37.731055 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f84243b3-3a22-4a2b-9800-7a62dc7da367 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:37.748614 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f84243b3-3a22-4a2b-9800-7a62dc7da367 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:37.750428 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f84243b3-3a22-4a2b-9800-7a62dc7da367 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:37.751945 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f84243b3-3a22-4a2b-9800-7a62dc7da367 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.325776 May 16 18:55:37.752421 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 443/882] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:37 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:37.855826 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a0557aa2-1e4e-41f3-a6a0-e2fe4dd3a515 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:37.869496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a0557aa2-1e4e-41f3-a6a0-e2fe4dd3a515 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.244478 May 16 18:55:37.870360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 440/883] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:37 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:38.774562 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-76218fd6-c1f5-4e44-a0c4-eed6313e0c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:38.775166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-76218fd6-c1f5-4e44-a0c4-eed6313e0c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:38.784021 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76218fd6-c1f5-4e44-a0c4-eed6313e0c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:38.784821 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76218fd6-c1f5-4e44-a0c4-eed6313e0c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:38.786157 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76218fd6-c1f5-4e44-a0c4-eed6313e0c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:38.786761 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-76218fd6-c1f5-4e44-a0c4-eed6313e0c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:38.892392 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0071b976-3da0-4238-bfd2-bfc0e32889e5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:38.894325 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0071b976-3da0-4238-bfd2-bfc0e32889e5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:38.914321 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0071b976-3da0-4238-bfd2-bfc0e32889e5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:38.915522 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0071b976-3da0-4238-bfd2-bfc0e32889e5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:38.920974 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0071b976-3da0-4238-bfd2-bfc0e32889e5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:38.922205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0071b976-3da0-4238-bfd2-bfc0e32889e5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:39.008137 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-76218fd6-c1f5-4e44-a0c4-eed6313e0c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:39.016775 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-76218fd6-c1f5-4e44-a0c4-eed6313e0c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:39.018440 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-76218fd6-c1f5-4e44-a0c4-eed6313e0c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:39.019879 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-76218fd6-c1f5-4e44-a0c4-eed6313e0c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.251052 May 16 18:55:39.020441 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 444/884] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:38 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:39.150493 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0071b976-3da0-4238-bfd2-bfc0e32889e5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:39.162783 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0071b976-3da0-4238-bfd2-bfc0e32889e5 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.277915 May 16 18:55:39.163849 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 441/885] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:38 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:40.050249 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-83352176-36d1-4404-a624-4142a18ec3ca tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:40.050958 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-83352176-36d1-4404-a624-4142a18ec3ca tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:40.058888 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-83352176-36d1-4404-a624-4142a18ec3ca tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:40.059284 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-83352176-36d1-4404-a624-4142a18ec3ca tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:40.060115 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-83352176-36d1-4404-a624-4142a18ec3ca tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:40.060545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-83352176-36d1-4404-a624-4142a18ec3ca tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:40.183211 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-58b985ca-63b0-4b65-ba94-bcc523820baa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:40.184598 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-58b985ca-63b0-4b65-ba94-bcc523820baa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:40.200759 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58b985ca-63b0-4b65-ba94-bcc523820baa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:40.201314 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58b985ca-63b0-4b65-ba94-bcc523820baa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:40.202534 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58b985ca-63b0-4b65-ba94-bcc523820baa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:40.203092 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-58b985ca-63b0-4b65-ba94-bcc523820baa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:40.270966 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-83352176-36d1-4404-a624-4142a18ec3ca tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:40.281485 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-83352176-36d1-4404-a624-4142a18ec3ca tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:40.284036 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-83352176-36d1-4404-a624-4142a18ec3ca tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:40.286094 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-83352176-36d1-4404-a624-4142a18ec3ca tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.239489 May 16 18:55:40.287142 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 445/886] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:40 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:40.400235 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-58b985ca-63b0-4b65-ba94-bcc523820baa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:40.416055 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-58b985ca-63b0-4b65-ba94-bcc523820baa tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.238297 May 16 18:55:40.416976 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 442/887] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:40 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:41.309888 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-dd25ae9a-8061-4af0-947e-6b24c051a396 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:41.310438 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-dd25ae9a-8061-4af0-947e-6b24c051a396 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:41.317434 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dd25ae9a-8061-4af0-947e-6b24c051a396 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:41.317882 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dd25ae9a-8061-4af0-947e-6b24c051a396 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:41.319237 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dd25ae9a-8061-4af0-947e-6b24c051a396 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:41.319670 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dd25ae9a-8061-4af0-947e-6b24c051a396 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:41.434834 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ad3b784c-3227-40f5-9c42-cf60208d1506 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:41.435754 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ad3b784c-3227-40f5-9c42-cf60208d1506 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:41.442873 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad3b784c-3227-40f5-9c42-cf60208d1506 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:41.443848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad3b784c-3227-40f5-9c42-cf60208d1506 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:41.445090 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad3b784c-3227-40f5-9c42-cf60208d1506 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:41.445540 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad3b784c-3227-40f5-9c42-cf60208d1506 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:41.516055 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dd25ae9a-8061-4af0-947e-6b24c051a396 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:41.532132 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dd25ae9a-8061-4af0-947e-6b24c051a396 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:41.535038 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dd25ae9a-8061-4af0-947e-6b24c051a396 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:41.537770 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-dd25ae9a-8061-4af0-947e-6b24c051a396 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.232819 May 16 18:55:41.539063 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 446/888] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:41 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:41.630243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ad3b784c-3227-40f5-9c42-cf60208d1506 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:41.643404 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ad3b784c-3227-40f5-9c42-cf60208d1506 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.212672 May 16 18:55:41.651034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 443/889] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:41 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:41.739742 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-31cd88da-dd6a-4e78-94e0-387608afa748 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:41.740333 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-31cd88da-dd6a-4e78-94e0-387608afa748 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:41.747053 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-31cd88da-dd6a-4e78-94e0-387608afa748 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:41.747502 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-31cd88da-dd6a-4e78-94e0-387608afa748 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:41.748323 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-31cd88da-dd6a-4e78-94e0-387608afa748 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:41.748767 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-31cd88da-dd6a-4e78-94e0-387608afa748 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:41.778279 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-31cd88da-dd6a-4e78-94e0-387608afa748 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/ips" status: 200 len: 145 microversion: 2.1 time: 0.043309 May 16 18:55:41.778874 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 447/890] 10.222.0.72 () {58 vars in 1247 bytes} [Mon May 16 18:55:41 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:42.571313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-bc8034ac-3abc-47bf-a6cc-c88eaddf33c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:42.572230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-bc8034ac-3abc-47bf-a6cc-c88eaddf33c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:42.581786 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bc8034ac-3abc-47bf-a6cc-c88eaddf33c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:42.582713 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bc8034ac-3abc-47bf-a6cc-c88eaddf33c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:42.585335 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bc8034ac-3abc-47bf-a6cc-c88eaddf33c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:42.586146 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bc8034ac-3abc-47bf-a6cc-c88eaddf33c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:42.679936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-dabf150d-65a5-4b6b-8b55-68faea479bec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:42.681343 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-dabf150d-65a5-4b6b-8b55-68faea479bec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:42.695894 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dabf150d-65a5-4b6b-8b55-68faea479bec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:42.697055 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dabf150d-65a5-4b6b-8b55-68faea479bec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:42.698755 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dabf150d-65a5-4b6b-8b55-68faea479bec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:42.699865 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dabf150d-65a5-4b6b-8b55-68faea479bec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:42.786106 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bc8034ac-3abc-47bf-a6cc-c88eaddf33c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:42.801654 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bc8034ac-3abc-47bf-a6cc-c88eaddf33c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:42.804404 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bc8034ac-3abc-47bf-a6cc-c88eaddf33c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:42.805789 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-bc8034ac-3abc-47bf-a6cc-c88eaddf33c2 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.245124 May 16 18:55:42.806401 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 444/891] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:42 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:42.937553 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dabf150d-65a5-4b6b-8b55-68faea479bec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:42.950020 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-dabf150d-65a5-4b6b-8b55-68faea479bec tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.286763 May 16 18:55:42.950622 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 448/892] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:42 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:43.325825 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6ffdcb96-c992-42ea-87bf-6819de039180 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7653f014-217b-4de4-be5e-e70d1279330c"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:43.327862 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6ffdcb96-c992-42ea-87bf-6819de039180 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:43.336111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ffdcb96-c992-42ea-87bf-6819de039180 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:43.336628 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ffdcb96-c992-42ea-87bf-6819de039180 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:43.337470 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ffdcb96-c992-42ea-87bf-6819de039180 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:43.337951 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6ffdcb96-c992-42ea-87bf-6819de039180 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:43.834586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9c586f11-e9c7-435f-82f0-2255a694bea5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:43.835383 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9c586f11-e9c7-435f-82f0-2255a694bea5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:43.843265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c586f11-e9c7-435f-82f0-2255a694bea5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:43.843737 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c586f11-e9c7-435f-82f0-2255a694bea5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:43.844518 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c586f11-e9c7-435f-82f0-2255a694bea5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:43.844954 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9c586f11-e9c7-435f-82f0-2255a694bea5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:44.011047 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9c586f11-e9c7-435f-82f0-2255a694bea5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:44.018990 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9c586f11-e9c7-435f-82f0-2255a694bea5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:44.020566 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9c586f11-e9c7-435f-82f0-2255a694bea5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:44.022341 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9c586f11-e9c7-435f-82f0-2255a694bea5 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.195098 May 16 18:55:44.022905 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 449/893] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:43 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:44.027480 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7ba3225f-95ee-41e9-be2e-4b67a174f4e8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:44.028189 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7ba3225f-95ee-41e9-be2e-4b67a174f4e8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:44.040154 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7ba3225f-95ee-41e9-be2e-4b67a174f4e8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:44.041477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7ba3225f-95ee-41e9-be2e-4b67a174f4e8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:44.044215 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7ba3225f-95ee-41e9-be2e-4b67a174f4e8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:44.045367 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7ba3225f-95ee-41e9-be2e-4b67a174f4e8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:44.225676 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7ba3225f-95ee-41e9-be2e-4b67a174f4e8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:44.241841 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7ba3225f-95ee-41e9-be2e-4b67a174f4e8 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.217732 May 16 18:55:44.242890 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 450/894] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:44 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:45.044078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f6c6145c-aee7-4e93-ae46-5d3c6905df09 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:45.045500 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f6c6145c-aee7-4e93-ae46-5d3c6905df09 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:45.052029 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f6c6145c-aee7-4e93-ae46-5d3c6905df09 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:45.053341 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f6c6145c-aee7-4e93-ae46-5d3c6905df09 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:45.054130 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f6c6145c-aee7-4e93-ae46-5d3c6905df09 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:45.054565 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f6c6145c-aee7-4e93-ae46-5d3c6905df09 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:45.224729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f6c6145c-aee7-4e93-ae46-5d3c6905df09 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:45.232636 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f6c6145c-aee7-4e93-ae46-5d3c6905df09 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:45.234129 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f6c6145c-aee7-4e93-ae46-5d3c6905df09 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:45.235274 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f6c6145c-aee7-4e93-ae46-5d3c6905df09 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.195427 May 16 18:55:45.235962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 451/895] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:45 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:45.271954 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-dce4168e-913a-42b8-adc5-2611b80bbcb1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:45.273110 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-dce4168e-913a-42b8-adc5-2611b80bbcb1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:45.284458 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dce4168e-913a-42b8-adc5-2611b80bbcb1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:45.285238 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dce4168e-913a-42b8-adc5-2611b80bbcb1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:45.286650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dce4168e-913a-42b8-adc5-2611b80bbcb1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:45.287418 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dce4168e-913a-42b8-adc5-2611b80bbcb1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:45.494797 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dce4168e-913a-42b8-adc5-2611b80bbcb1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:45.502780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-dce4168e-913a-42b8-adc5-2611b80bbcb1 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.239023 May 16 18:55:45.503394 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 452/896] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:45 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:46.256463 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6142686e-a3ee-4198-9952-5836c4fe36ef tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:46.258057 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6142686e-a3ee-4198-9952-5836c4fe36ef tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:46.264032 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6142686e-a3ee-4198-9952-5836c4fe36ef tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:46.264492 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6142686e-a3ee-4198-9952-5836c4fe36ef tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:46.265317 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6142686e-a3ee-4198-9952-5836c4fe36ef tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:46.265789 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6142686e-a3ee-4198-9952-5836c4fe36ef tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:46.453544 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6142686e-a3ee-4198-9952-5836c4fe36ef tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:46.466211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6142686e-a3ee-4198-9952-5836c4fe36ef tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:46.469426 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6142686e-a3ee-4198-9952-5836c4fe36ef tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:46.471610 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6142686e-a3ee-4198-9952-5836c4fe36ef tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.219704 May 16 18:55:46.472683 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 453/897] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:46 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:46.523030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8616a940-64fe-479c-b2da-947d0d251b33 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:46.523544 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8616a940-64fe-479c-b2da-947d0d251b33 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:46.531656 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8616a940-64fe-479c-b2da-947d0d251b33 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:46.532272 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8616a940-64fe-479c-b2da-947d0d251b33 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:46.533058 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8616a940-64fe-479c-b2da-947d0d251b33 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:46.533498 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8616a940-64fe-479c-b2da-947d0d251b33 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:46.712718 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8616a940-64fe-479c-b2da-947d0d251b33 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:46.722679 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8616a940-64fe-479c-b2da-947d0d251b33 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.203862 May 16 18:55:46.723911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 454/898] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:46 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:47.496335 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-62ac696c-4db2-47d1-b840-cbdce9133016 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:47.497376 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-62ac696c-4db2-47d1-b840-cbdce9133016 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:47.503866 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-62ac696c-4db2-47d1-b840-cbdce9133016 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:47.504349 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-62ac696c-4db2-47d1-b840-cbdce9133016 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:47.505146 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-62ac696c-4db2-47d1-b840-cbdce9133016 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:47.505990 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-62ac696c-4db2-47d1-b840-cbdce9133016 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:47.698430 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-62ac696c-4db2-47d1-b840-cbdce9133016 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:47.710509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-62ac696c-4db2-47d1-b840-cbdce9133016 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:47.713307 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-62ac696c-4db2-47d1-b840-cbdce9133016 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:47.713307 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-62ac696c-4db2-47d1-b840-cbdce9133016 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.221301 May 16 18:55:47.715865 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 455/899] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:47 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:47.747797 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-73890593-9d9b-4b76-8256-88f325f5924f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:47.748407 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-73890593-9d9b-4b76-8256-88f325f5924f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:47.754662 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-73890593-9d9b-4b76-8256-88f325f5924f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:47.755183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-73890593-9d9b-4b76-8256-88f325f5924f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:47.757226 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-73890593-9d9b-4b76-8256-88f325f5924f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:47.757676 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-73890593-9d9b-4b76-8256-88f325f5924f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:47.951094 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-73890593-9d9b-4b76-8256-88f325f5924f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:47.962366 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-73890593-9d9b-4b76-8256-88f325f5924f tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.218792 May 16 18:55:47.962965 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 456/900] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:47 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:48.733562 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f67a2844-948c-443f-a438-b5b26c017698 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:48.734279 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f67a2844-948c-443f-a438-b5b26c017698 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:48.741324 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f67a2844-948c-443f-a438-b5b26c017698 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:48.741777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f67a2844-948c-443f-a438-b5b26c017698 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:48.742560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f67a2844-948c-443f-a438-b5b26c017698 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:48.742999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f67a2844-948c-443f-a438-b5b26c017698 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:48.922597 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f67a2844-948c-443f-a438-b5b26c017698 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:48.939115 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f67a2844-948c-443f-a438-b5b26c017698 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:48.941770 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f67a2844-948c-443f-a438-b5b26c017698 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:48.943180 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f67a2844-948c-443f-a438-b5b26c017698 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.213619 May 16 18:55:48.943646 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 457/901] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:48 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:48.981099 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d02af325-a558-4114-a4c9-301eeab0eabd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:48.981752 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d02af325-a558-4114-a4c9-301eeab0eabd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:48.988328 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d02af325-a558-4114-a4c9-301eeab0eabd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:48.988718 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d02af325-a558-4114-a4c9-301eeab0eabd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:48.989936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d02af325-a558-4114-a4c9-301eeab0eabd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:48.990546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d02af325-a558-4114-a4c9-301eeab0eabd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:49.147155 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d02af325-a558-4114-a4c9-301eeab0eabd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:49.155084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d02af325-a558-4114-a4c9-301eeab0eabd tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.177911 May 16 18:55:49.155687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 458/902] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:48 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:49.160448 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-10168e6f-18c4-4715-9a19-9f99396e512a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:49.160946 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-10168e6f-18c4-4715-9a19-9f99396e512a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:49.168237 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-10168e6f-18c4-4715-9a19-9f99396e512a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:49.168802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-10168e6f-18c4-4715-9a19-9f99396e512a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:49.169915 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-10168e6f-18c4-4715-9a19-9f99396e512a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:49.170277 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-10168e6f-18c4-4715-9a19-9f99396e512a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:49.203616 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-10168e6f-18c4-4715-9a19-9f99396e512a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/ips" status: 200 len: 149 microversion: 2.1 time: 0.046849 May 16 18:55:49.204268 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 459/903] 10.222.0.72 () {58 vars in 1247 bytes} [Mon May 16 18:55:49 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:49.962022 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e9916045-404c-4bb4-b6bc-1db899564023 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:49.963095 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-e9916045-404c-4bb4-b6bc-1db899564023 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:49.970280 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e9916045-404c-4bb4-b6bc-1db899564023 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:49.970735 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e9916045-404c-4bb4-b6bc-1db899564023 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:49.971552 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e9916045-404c-4bb4-b6bc-1db899564023 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:49.972043 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e9916045-404c-4bb4-b6bc-1db899564023 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:50.147110 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e9916045-404c-4bb4-b6bc-1db899564023 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:50.158103 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e9916045-404c-4bb4-b6bc-1db899564023 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:50.160240 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e9916045-404c-4bb4-b6bc-1db899564023 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:50.162317 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e9916045-404c-4bb4-b6bc-1db899564023 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.203624 May 16 18:55:50.163194 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 460/904] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:49 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:50.178233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-46c0a2c2-af5b-4b6f-adb7-e6eeb36d07f2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:50.179224 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-46c0a2c2-af5b-4b6f-adb7-e6eeb36d07f2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:50.187299 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46c0a2c2-af5b-4b6f-adb7-e6eeb36d07f2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:50.187657 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46c0a2c2-af5b-4b6f-adb7-e6eeb36d07f2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:50.188482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46c0a2c2-af5b-4b6f-adb7-e6eeb36d07f2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:50.188914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46c0a2c2-af5b-4b6f-adb7-e6eeb36d07f2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:50.346758 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-46c0a2c2-af5b-4b6f-adb7-e6eeb36d07f2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:50.357156 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-46c0a2c2-af5b-4b6f-adb7-e6eeb36d07f2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.185776 May 16 18:55:50.357972 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 461/905] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:50 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:50.578932 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2795ab02-e6aa-4631-a2cd-cb78d089f700 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "854d67fa-0e43-4fde-b7c6-5227de3f7637"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:50.580114 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2795ab02-e6aa-4631-a2cd-cb78d089f700 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:50.589764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2795ab02-e6aa-4631-a2cd-cb78d089f700 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:50.590401 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2795ab02-e6aa-4631-a2cd-cb78d089f700 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:50.592476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2795ab02-e6aa-4631-a2cd-cb78d089f700 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:50.593367 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2795ab02-e6aa-4631-a2cd-cb78d089f700 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:51.426369 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6ffdcb96-c992-42ea-87bf-6819de039180 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.108067 May 16 18:55:51.427604 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 445/906] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:55:43 2022] POST /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments => generated 194 bytes in 8110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:51.432961 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-038d9531-032e-421c-a554-122e29b057a3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:51.433868 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-038d9531-032e-421c-a554-122e29b057a3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:51.442016 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-038d9531-032e-421c-a554-122e29b057a3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:51.443287 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-038d9531-032e-421c-a554-122e29b057a3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:51.444282 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-038d9531-032e-421c-a554-122e29b057a3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:51.445577 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-038d9531-032e-421c-a554-122e29b057a3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:51.517562 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2795ab02-e6aa-4631-a2cd-cb78d089f700 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "POST /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.944621 May 16 18:55:51.524732 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 462/907] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:55:50 2022] POST /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:55:51.529455 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3648d4b2-6a92-4005-87b8-591c060da114 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:51.530146 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3648d4b2-6a92-4005-87b8-591c060da114 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:51.551960 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3648d4b2-6a92-4005-87b8-591c060da114 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:51.553064 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3648d4b2-6a92-4005-87b8-591c060da114 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:51.555544 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3648d4b2-6a92-4005-87b8-591c060da114 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:51.556594 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3648d4b2-6a92-4005-87b8-591c060da114 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:51.979000 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-038d9531-032e-421c-a554-122e29b057a3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:51.992998 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-038d9531-032e-421c-a554-122e29b057a3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:51.994994 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-038d9531-032e-421c-a554-122e29b057a3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:51.997383 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-038d9531-032e-421c-a554-122e29b057a3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.568704 May 16 18:55:51.998252 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 446/908] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:51 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:52.011520 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3648d4b2-6a92-4005-87b8-591c060da114 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:52.020672 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3648d4b2-6a92-4005-87b8-591c060da114 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1506 microversion: 2.1 time: 0.500626 May 16 18:55:52.028300 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 463/909] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:51 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:52.365194 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-5fdbc45a-2cb2-465f-b85f-817187e8944d req-2f79a4de-89cb-4c0c-9a8c-495fbee65560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d16c0a7-c769-407d-ae82-8f9437fbe7f2", "name": "network-vif-deleted", "tag": "0df5492d-e413-4dd6-a47e-19957da57f3f"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:52.388186 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-5fdbc45a-2cb2-465f-b85f-817187e8944d req-2f79a4de-89cb-4c0c-9a8c-495fbee65560 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:52.388717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-5fdbc45a-2cb2-465f-b85f-817187e8944d req-2f79a4de-89cb-4c0c-9a8c-495fbee65560 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:52.406828 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-5fdbc45a-2cb2-465f-b85f-817187e8944d req-2f79a4de-89cb-4c0c-9a8c-495fbee65560 service nova] Creating event network-vif-deleted:0df5492d-e413-4dd6-a47e-19957da57f3f for instance 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 on hv-cinder-75078 May 16 18:55:52.412227 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-5fdbc45a-2cb2-465f-b85f-817187e8944d req-2f79a4de-89cb-4c0c-9a8c-495fbee65560 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051647 May 16 18:55:52.413464 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 447/910] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:53.020039 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5e708e8b-8393-4ee1-a832-50c42077a2ab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:53.020820 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5e708e8b-8393-4ee1-a832-50c42077a2ab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:53.027663 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5e708e8b-8393-4ee1-a832-50c42077a2ab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:53.028202 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5e708e8b-8393-4ee1-a832-50c42077a2ab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:53.028921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5e708e8b-8393-4ee1-a832-50c42077a2ab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:53.029352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5e708e8b-8393-4ee1-a832-50c42077a2ab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:53.044080 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-45d40b69-1d8e-40d3-8b49-e29d0a15d1c7 req-46acf5d2-dadb-4161-a9ed-35586dd84e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b2dd21-9b22-4230-8bee-d6f04f06019f", "name": "network-vif-plugged", "status": "completed", "tag": "7c023405-87f2-4ed0-9c4c-c419d714714d"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:53.057649 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-45d40b69-1d8e-40d3-8b49-e29d0a15d1c7 req-46acf5d2-dadb-4161-a9ed-35586dd84e3d service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:53.058313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-45d40b69-1d8e-40d3-8b49-e29d0a15d1c7 req-46acf5d2-dadb-4161-a9ed-35586dd84e3d service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:53.071510 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-45d40b69-1d8e-40d3-8b49-e29d0a15d1c7 req-46acf5d2-dadb-4161-a9ed-35586dd84e3d service nova] Creating event network-vif-plugged:7c023405-87f2-4ed0-9c4c-c419d714714d for instance 86b2dd21-9b22-4230-8bee-d6f04f06019f on hv-cinder-75078 May 16 18:55:53.093722 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-45d40b69-1d8e-40d3-8b49-e29d0a15d1c7 req-46acf5d2-dadb-4161-a9ed-35586dd84e3d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053949 May 16 18:55:53.095135 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 448/911] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:53.117973 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:53.119542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:53.135372 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:53.136129 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:53.137245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:53.137683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:53.226389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:53.227222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:53.227921 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lazy-loading 'fault' on Instance uuid 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:55:53.272417 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5e708e8b-8393-4ee1-a832-50c42077a2ab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:53.289535 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5e708e8b-8393-4ee1-a832-50c42077a2ab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:53.292535 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5e708e8b-8393-4ee1-a832-50c42077a2ab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:53.294335 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:53.294761 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5e708e8b-8393-4ee1-a832-50c42077a2ab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.278916 May 16 18:55:53.299177 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 464/912] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:53 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:53.306456 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e0bc2fc9-ceb1-4ee6-837b-2c18d300959a tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 200 len: 1311 microversion: 2.1 time: 0.209693 May 16 18:55:53.307041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 449/913] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:53 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:54.316949 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a8712084-12c9-446e-ac49-55c787fd9c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:54.317608 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a8712084-12c9-446e-ac49-55c787fd9c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:54.324743 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a8712084-12c9-446e-ac49-55c787fd9c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:54.325240 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a8712084-12c9-446e-ac49-55c787fd9c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:54.326181 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a8712084-12c9-446e-ac49-55c787fd9c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:54.326679 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a8712084-12c9-446e-ac49-55c787fd9c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:54.335477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-013ee2b2-ed7b-4819-80d4-9784345df975 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:54.336144 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-013ee2b2-ed7b-4819-80d4-9784345df975 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: 8d16c0a7-c769-407d-ae82-8f9437fbe7f2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:54.342867 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-013ee2b2-ed7b-4819-80d4-9784345df975 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:54.343320 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-013ee2b2-ed7b-4819-80d4-9784345df975 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:54.344125 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-013ee2b2-ed7b-4819-80d4-9784345df975 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:54.344556 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-013ee2b2-ed7b-4819-80d4-9784345df975 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:54.360618 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-013ee2b2-ed7b-4819-80d4-9784345df975 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] HTTP exception thrown: Instance 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 could not be found. May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-013ee2b2-ed7b-4819-80d4-9784345df975 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Request method failure captured: May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 HTTP/1.1 May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpzg_Pwgwncj8s5c-vohUPtNAuGaR132lrZYw_aU8QzfdorNmdIes6ufMp_OpEpKC8RJG-tNmWB2qOSEHIYoYS2_ry6eMVKghmNBWXn50nOzP_tfjsnxTAesZPSPNnVmxEieajJZdqMpkVwbQctsn13iD0NMbnMI0cGFqADMHG_Pgqw May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 9fe0e3c0f5eb4d4199f084be233eb1d3 May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:55:54.362249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 9fe0e3c0f5eb4d4199f084be233eb1d3 May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-ServerRescueNegativeTestJSON-130323987-project May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 89539508b327427ba1a449fe30569606 May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-130323987-project May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 could not be found. May 16 18:55:54.365206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '8d16c0a7-c769-407d-ae82-8f9437fbe7f2'} May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 could not be found. May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:55:54.366802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 could not be found. May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 could not be found. May 16 18:55:54.368619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:55:54.370032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-013ee2b2-ed7b-4819-80d4-9784345df975 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Returning 404 to user: Instance 8d16c0a7-c769-407d-ae82-8f9437fbe7f2 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:55:54.370032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-013ee2b2-ed7b-4819-80d4-9784345df975 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2" status: 404 len: 111 microversion: 2.1 time: 0.034475 May 16 18:55:54.370032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 450/914] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:54 2022] GET /compute/v2.1/servers/8d16c0a7-c769-407d-ae82-8f9437fbe7f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 18:55:54.372327 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4414d4a3-aa89-4db6-b644-dccc20564a1c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:54.372823 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4414d4a3-aa89-4db6-b644-dccc20564a1c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:54.379303 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4414d4a3-aa89-4db6-b644-dccc20564a1c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:54.379798 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4414d4a3-aa89-4db6-b644-dccc20564a1c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:54.381585 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4414d4a3-aa89-4db6-b644-dccc20564a1c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:54.382023 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4414d4a3-aa89-4db6-b644-dccc20564a1c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:54.410690 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4414d4a3-aa89-4db6-b644-dccc20564a1c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:55:54.486620 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a8712084-12c9-446e-ac49-55c787fd9c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:54.495450 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a8712084-12c9-446e-ac49-55c787fd9c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:54.496980 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a8712084-12c9-446e-ac49-55c787fd9c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:54.498196 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a8712084-12c9-446e-ac49-55c787fd9c3e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.187951 May 16 18:55:54.498781 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 465/915] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:54 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:54.517682 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4414d4a3-aa89-4db6-b644-dccc20564a1c tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 204 len: 0 microversion: 2.1 time: 0.148790 May 16 18:55:54.518836 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 451/916] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:55:54 2022] DELETE /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:55:54.531397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0f2a18d6-9302-49cf-b2f5-cae51ae585e2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:54.532385 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0f2a18d6-9302-49cf-b2f5-cae51ae585e2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:54.541490 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0f2a18d6-9302-49cf-b2f5-cae51ae585e2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:54.542142 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0f2a18d6-9302-49cf-b2f5-cae51ae585e2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:54.543432 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0f2a18d6-9302-49cf-b2f5-cae51ae585e2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:54.544452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0f2a18d6-9302-49cf-b2f5-cae51ae585e2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:54.700203 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-0f2a18d6-9302-49cf-b2f5-cae51ae585e2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:54.709341 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0f2a18d6-9302-49cf-b2f5-cae51ae585e2 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.183368 May 16 18:55:54.718975 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 466/917] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:54 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:55.530250 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-32596c0c-3f65-47d2-9171-3f63e25b8243 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:55.530957 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-32596c0c-3f65-47d2-9171-3f63e25b8243 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:55.538206 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-32596c0c-3f65-47d2-9171-3f63e25b8243 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:55.538657 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-32596c0c-3f65-47d2-9171-3f63e25b8243 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:55.539441 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-32596c0c-3f65-47d2-9171-3f63e25b8243 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:55.539917 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-32596c0c-3f65-47d2-9171-3f63e25b8243 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:55.691792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-32596c0c-3f65-47d2-9171-3f63e25b8243 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:55.700751 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-32596c0c-3f65-47d2-9171-3f63e25b8243 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:55.702247 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-32596c0c-3f65-47d2-9171-3f63e25b8243 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:55.703440 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-32596c0c-3f65-47d2-9171-3f63e25b8243 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.177585 May 16 18:55:55.704033 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 452/918] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:55 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:55:55.732078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-29fad90d-07ef-4691-b592-25c01d069c9e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:55.733051 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-29fad90d-07ef-4691-b592-25c01d069c9e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:55.740804 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-29fad90d-07ef-4691-b592-25c01d069c9e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:55.741454 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-29fad90d-07ef-4691-b592-25c01d069c9e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:55.742276 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-29fad90d-07ef-4691-b592-25c01d069c9e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:55.742722 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-29fad90d-07ef-4691-b592-25c01d069c9e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:55.887860 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-29fad90d-07ef-4691-b592-25c01d069c9e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:55.896051 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-29fad90d-07ef-4691-b592-25c01d069c9e tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.167825 May 16 18:55:55.896807 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 467/919] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:55 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:56.726584 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-aabb5d14-04ab-42d1-97b7-3a92180be3ea tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:56.727285 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-aabb5d14-04ab-42d1-97b7-3a92180be3ea tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:56.735306 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aabb5d14-04ab-42d1-97b7-3a92180be3ea tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:56.736087 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aabb5d14-04ab-42d1-97b7-3a92180be3ea tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:56.737381 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aabb5d14-04ab-42d1-97b7-3a92180be3ea tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:56.738098 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-aabb5d14-04ab-42d1-97b7-3a92180be3ea tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:56.930827 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c86a6799-a2e3-41e5-b1ab-5c454361d709 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:56.932059 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c86a6799-a2e3-41e5-b1ab-5c454361d709 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:56.945179 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c86a6799-a2e3-41e5-b1ab-5c454361d709 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:56.946219 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c86a6799-a2e3-41e5-b1ab-5c454361d709 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:56.947907 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c86a6799-a2e3-41e5-b1ab-5c454361d709 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:56.949041 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c86a6799-a2e3-41e5-b1ab-5c454361d709 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:56.956829 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-aabb5d14-04ab-42d1-97b7-3a92180be3ea tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:56.974888 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-aabb5d14-04ab-42d1-97b7-3a92180be3ea tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:56.978855 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-aabb5d14-04ab-42d1-97b7-3a92180be3ea tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:56.981260 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-aabb5d14-04ab-42d1-97b7-3a92180be3ea tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1728 microversion: 2.20 time: 0.258570 May 16 18:55:56.986901 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 453/920] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:56 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1728 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:57.348059 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c86a6799-a2e3-41e5-b1ab-5c454361d709 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:57.356574 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c86a6799-a2e3-41e5-b1ab-5c454361d709 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.439548 May 16 18:55:57.357159 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 468/921] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:56 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:55:58.011382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a29a6af2-eccf-49c7-8fb5-38d3426f269e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:58.012122 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a29a6af2-eccf-49c7-8fb5-38d3426f269e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:58.018987 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a29a6af2-eccf-49c7-8fb5-38d3426f269e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:58.019442 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a29a6af2-eccf-49c7-8fb5-38d3426f269e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:58.020265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a29a6af2-eccf-49c7-8fb5-38d3426f269e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:58.021843 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a29a6af2-eccf-49c7-8fb5-38d3426f269e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:58.274418 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a29a6af2-eccf-49c7-8fb5-38d3426f269e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:58.289911 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a29a6af2-eccf-49c7-8fb5-38d3426f269e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:58.291395 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-a29a6af2-eccf-49c7-8fb5-38d3426f269e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:58.292659 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a29a6af2-eccf-49c7-8fb5-38d3426f269e tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1715 microversion: 2.20 time: 0.287198 May 16 18:55:58.293244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 454/922] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:55:58 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1715 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:55:58.376412 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ec7cb81c-3d77-41f3-8d59-4374869a6cbc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:58.377017 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ec7cb81c-3d77-41f3-8d59-4374869a6cbc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:58.384583 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ec7cb81c-3d77-41f3-8d59-4374869a6cbc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:58.385039 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ec7cb81c-3d77-41f3-8d59-4374869a6cbc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:58.385943 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ec7cb81c-3d77-41f3-8d59-4374869a6cbc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:58.386401 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ec7cb81c-3d77-41f3-8d59-4374869a6cbc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:58.636639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-db24cf62-7f2f-47f5-9d11-0119fb39b99f req-93fb2dee-ab2a-4aeb-a52e-aba8d8eb1fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2573d57-ebb1-4daf-8809-cdc7c0d32eac", "name": "network-vif-deleted", "tag": "64e7bba5-2463-4d81-9a62-7e09cbe676f8"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:55:58.648854 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-db24cf62-7f2f-47f5-9d11-0119fb39b99f req-93fb2dee-ab2a-4aeb-a52e-aba8d8eb1fab service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:58.649300 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-db24cf62-7f2f-47f5-9d11-0119fb39b99f req-93fb2dee-ab2a-4aeb-a52e-aba8d8eb1fab service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:58.649572 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ec7cb81c-3d77-41f3-8d59-4374869a6cbc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89539508b327427ba1a449fe30569606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:55:58.668424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ec7cb81c-3d77-41f3-8d59-4374869a6cbc tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 200 len: 1521 microversion: 2.1 time: 0.296194 May 16 18:55:58.669715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-db24cf62-7f2f-47f5-9d11-0119fb39b99f req-93fb2dee-ab2a-4aeb-a52e-aba8d8eb1fab service nova] Creating event network-vif-deleted:64e7bba5-2463-4d81-9a62-7e09cbe676f8 for instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac on hv-cinder-75078 May 16 18:55:58.670244 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 469/923] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:58 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:55:58.676273 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-db24cf62-7f2f-47f5-9d11-0119fb39b99f req-93fb2dee-ab2a-4aeb-a52e-aba8d8eb1fab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042629 May 16 18:55:58.677728 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 455/924] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:59.077760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d1571a60-fc80-4194-bd70-f5da8236a56d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:59.079263 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d1571a60-fc80-4194-bd70-f5da8236a56d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:59.092721 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1571a60-fc80-4194-bd70-f5da8236a56d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:59.093905 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1571a60-fc80-4194-bd70-f5da8236a56d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:59.095591 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1571a60-fc80-4194-bd70-f5da8236a56d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:59.096687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1571a60-fc80-4194-bd70-f5da8236a56d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:59.164085 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d1571a60-fc80-4194-bd70-f5da8236a56d tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092279 May 16 18:55:59.165096 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 470/925] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:55:59 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:59.180151 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-258c018b-7033-42cd-b3b5-06731ca41fd4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:59.180732 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-258c018b-7033-42cd-b3b5-06731ca41fd4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:59.199995 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-258c018b-7033-42cd-b3b5-06731ca41fd4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:59.200762 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-258c018b-7033-42cd-b3b5-06731ca41fd4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:59.201921 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-258c018b-7033-42cd-b3b5-06731ca41fd4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:59.202679 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-258c018b-7033-42cd-b3b5-06731ca41fd4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:59.234284 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-258c018b-7033-42cd-b3b5-06731ca41fd4 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments/7653f014-217b-4de4-be5e-e70d1279330c" status: 200 len: 194 microversion: 2.1 time: 0.061308 May 16 18:55:59.234897 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 456/926] 10.222.0.72 () {58 vars in 1412 bytes} [Mon May 16 18:55:59 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments/7653f014-217b-4de4-be5e-e70d1279330c => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:55:59.687173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c8c720a2-c1ee-4655-adab-f3591dedcc51 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:55:59.687739 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c8c720a2-c1ee-4655-adab-f3591dedcc51 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] [instance: a2573d57-ebb1-4daf-8809-cdc7c0d32eac] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:55:59.694319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c8c720a2-c1ee-4655-adab-f3591dedcc51 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:59.694766 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c8c720a2-c1ee-4655-adab-f3591dedcc51 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:59.695548 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c8c720a2-c1ee-4655-adab-f3591dedcc51 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:55:59.696014 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c8c720a2-c1ee-4655-adab-f3591dedcc51 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:55:59.710015 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-c8c720a2-c1ee-4655-adab-f3591dedcc51 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] HTTP exception thrown: Instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac could not be found. May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c8c720a2-c1ee-4655-adab-f3591dedcc51 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Request method failure captured: May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac HTTP/1.1 May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpzg_Pwgwncj8s5c-vohUPtNAuGaR132lrZYw_aU8QzfdorNmdIes6ufMp_OpEpKC8RJG-tNmWB2qOSEHIYoYS2_ry6eMVKghmNBWXn50nOzP_tfjsnxTAesZPSPNnVmxEieajJZdqMpkVwbQctsn13iD0NMbnMI0cGFqADMHG_Pgqw May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 9fe0e3c0f5eb4d4199f084be233eb1d3 May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:55:59.711665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9fe0e3c0f5eb4d4199f084be233eb1d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 9fe0e3c0f5eb4d4199f084be233eb1d3 May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-130323987 May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-ServerRescueNegativeTestJSON-130323987-project May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 89539508b327427ba1a449fe30569606 May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-130323987-project May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac could not be found. May 16 18:55:59.713105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'a2573d57-ebb1-4daf-8809-cdc7c0d32eac'} May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac could not be found. May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:55:59.713857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac could not be found. May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac could not be found. May 16 18:55:59.715321 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:55:59.716780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c8c720a2-c1ee-4655-adab-f3591dedcc51 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] Returning 404 to user: Instance a2573d57-ebb1-4daf-8809-cdc7c0d32eac could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:55:59.716780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c8c720a2-c1ee-4655-adab-f3591dedcc51 tempest-ServerRescueNegativeTestJSON-130323987 tempest-ServerRescueNegativeTestJSON-130323987-project] 10.222.0.72 "GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac" status: 404 len: 111 microversion: 2.1 time: 0.030006 May 16 18:55:59.716780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 471/927] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:55:59 2022] GET /compute/v2.1/servers/a2573d57-ebb1-4daf-8809-cdc7c0d32eac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:00.577396 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-36fe93c3-fa1c-44ef-8bb9-f90d8217d47b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82eb78c0-d848-4330-bfb4-d447a64ffe99"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:56:00.579173 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-36fe93c3-fa1c-44ef-8bb9-f90d8217d47b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:00.597315 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36fe93c3-fa1c-44ef-8bb9-f90d8217d47b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:00.599256 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36fe93c3-fa1c-44ef-8bb9-f90d8217d47b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:00.600786 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36fe93c3-fa1c-44ef-8bb9-f90d8217d47b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:00.601470 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36fe93c3-fa1c-44ef-8bb9-f90d8217d47b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:00.925047 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-36fe93c3-fa1c-44ef-8bb9-f90d8217d47b tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "POST /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354067 May 16 18:56:00.926142 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 457/928] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:56:00 2022] POST /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:05.736102 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ebcc2489-5435-4d1e-9341-eb5e45829183 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:05.736734 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ebcc2489-5435-4d1e-9341-eb5e45829183 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:05.745198 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ebcc2489-5435-4d1e-9341-eb5e45829183 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:05.745645 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ebcc2489-5435-4d1e-9341-eb5e45829183 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:05.746414 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ebcc2489-5435-4d1e-9341-eb5e45829183 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:05.746849 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ebcc2489-5435-4d1e-9341-eb5e45829183 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:05.858595 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-ebcc2489-5435-4d1e-9341-eb5e45829183 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lazy-loading 'services' on Instance uuid 330d5725-0fac-4ad5-942f-f74fdc9bfbfb {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:56:05.948214 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ebcc2489-5435-4d1e-9341-eb5e45829183 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments/854d67fa-0e43-4fde-b7c6-5227de3f7637" status: 202 len: 0 microversion: 2.1 time: 0.215697 May 16 18:56:05.949150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 472/929] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 18:56:05 2022] DELETE /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments/854d67fa-0e43-4fde-b7c6-5227de3f7637 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:56:05.959180 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c83cfc12-3fe8-452b-ba1c-9f7625d79919 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:05.961840 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c83cfc12-3fe8-452b-ba1c-9f7625d79919 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:05.971060 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c83cfc12-3fe8-452b-ba1c-9f7625d79919 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:05.971542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c83cfc12-3fe8-452b-ba1c-9f7625d79919 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:05.972581 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c83cfc12-3fe8-452b-ba1c-9f7625d79919 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:05.972979 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c83cfc12-3fe8-452b-ba1c-9f7625d79919 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:06.013339 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c83cfc12-3fe8-452b-ba1c-9f7625d79919 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059558 May 16 18:56:06.013919 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 458/930] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:05 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:07.026787 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9f5ab40a-d9d8-4a72-afe5-aab9c973be01 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:07.027818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9f5ab40a-d9d8-4a72-afe5-aab9c973be01 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:07.033965 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9f5ab40a-d9d8-4a72-afe5-aab9c973be01 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:07.034409 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9f5ab40a-d9d8-4a72-afe5-aab9c973be01 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:07.035162 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9f5ab40a-d9d8-4a72-afe5-aab9c973be01 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:07.035591 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9f5ab40a-d9d8-4a72-afe5-aab9c973be01 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:07.064638 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9f5ab40a-d9d8-4a72-afe5-aab9c973be01 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042765 May 16 18:56:07.065179 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 473/931] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:07 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:08.080419 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-587fa1ae-830a-484f-a5cb-1c3005629ec1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:08.082108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-587fa1ae-830a-484f-a5cb-1c3005629ec1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:08.091388 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-587fa1ae-830a-484f-a5cb-1c3005629ec1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:08.092112 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-587fa1ae-830a-484f-a5cb-1c3005629ec1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:08.092885 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-587fa1ae-830a-484f-a5cb-1c3005629ec1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:08.093312 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-587fa1ae-830a-484f-a5cb-1c3005629ec1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:08.124104 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-587fa1ae-830a-484f-a5cb-1c3005629ec1 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050663 May 16 18:56:08.124678 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 459/932] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:08 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:09.139651 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9097ebaa-8079-469c-96c3-714ca00b7c15 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:09.140604 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9097ebaa-8079-469c-96c3-714ca00b7c15 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:09.147963 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9097ebaa-8079-469c-96c3-714ca00b7c15 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:09.148414 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9097ebaa-8079-469c-96c3-714ca00b7c15 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:09.149176 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9097ebaa-8079-469c-96c3-714ca00b7c15 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:09.149611 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9097ebaa-8079-469c-96c3-714ca00b7c15 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:09.182405 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9097ebaa-8079-469c-96c3-714ca00b7c15 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046695 May 16 18:56:09.182970 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 474/933] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:09 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:10.194718 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-359ab3dc-115d-4562-a0b7-b2589d4401e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:10.195577 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-359ab3dc-115d-4562-a0b7-b2589d4401e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:10.202166 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-359ab3dc-115d-4562-a0b7-b2589d4401e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:10.202616 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-359ab3dc-115d-4562-a0b7-b2589d4401e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:10.203406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-359ab3dc-115d-4562-a0b7-b2589d4401e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:10.203979 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-359ab3dc-115d-4562-a0b7-b2589d4401e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:10.235289 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-359ab3dc-115d-4562-a0b7-b2589d4401e7 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 May 16 18:56:10.235903 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 460/934] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:10 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:11.247153 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2269e5b3-c159-4e68-a77b-bff924fdbc41 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:11.248126 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2269e5b3-c159-4e68-a77b-bff924fdbc41 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:11.255265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2269e5b3-c159-4e68-a77b-bff924fdbc41 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:11.255726 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2269e5b3-c159-4e68-a77b-bff924fdbc41 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:11.256517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2269e5b3-c159-4e68-a77b-bff924fdbc41 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:11.256943 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2269e5b3-c159-4e68-a77b-bff924fdbc41 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:11.288492 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2269e5b3-c159-4e68-a77b-bff924fdbc41 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 May 16 18:56:11.289080 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 475/935] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:11 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:12.302305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-74fb9f83-f5d3-4dea-ab89-0688cf1123e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:12.306299 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-74fb9f83-f5d3-4dea-ab89-0688cf1123e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:12.316994 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-74fb9f83-f5d3-4dea-ab89-0688cf1123e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:12.317636 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-74fb9f83-f5d3-4dea-ab89-0688cf1123e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:12.318425 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-74fb9f83-f5d3-4dea-ab89-0688cf1123e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:12.318868 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-74fb9f83-f5d3-4dea-ab89-0688cf1123e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:12.356643 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-74fb9f83-f5d3-4dea-ab89-0688cf1123e3 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059813 May 16 18:56:12.357583 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 461/936] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:12 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:56:13.373375 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c86f1002-8975-4e33-8505-e0602182463e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:13.375177 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c86f1002-8975-4e33-8505-e0602182463e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:13.383642 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c86f1002-8975-4e33-8505-e0602182463e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:13.384138 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c86f1002-8975-4e33-8505-e0602182463e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:13.384926 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c86f1002-8975-4e33-8505-e0602182463e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:13.385367 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c86f1002-8975-4e33-8505-e0602182463e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:13.427485 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c86f1002-8975-4e33-8505-e0602182463e tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059069 May 16 18:56:13.428538 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 476/937] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:13 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:13.830936 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-80e41e2c-13d1-4bf4-86ff-d059ab92952e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:13.833166 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-80e41e2c-13d1-4bf4-86ff-d059ab92952e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:13.840552 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-80e41e2c-13d1-4bf4-86ff-d059ab92952e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:13.841006 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-80e41e2c-13d1-4bf4-86ff-d059ab92952e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:13.842076 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-80e41e2c-13d1-4bf4-86ff-d059ab92952e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:13.842512 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-80e41e2c-13d1-4bf4-86ff-d059ab92952e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:13.875935 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-80e41e2c-13d1-4bf4-86ff-d059ab92952e tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048929 May 16 18:56:13.876695 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 462/938] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:13 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:14.026507 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-873c2045-dd66-424e-930f-3eb06077ab97 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:14.027340 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-873c2045-dd66-424e-930f-3eb06077ab97 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:14.038341 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-873c2045-dd66-424e-930f-3eb06077ab97 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:14.039103 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-873c2045-dd66-424e-930f-3eb06077ab97 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:14.040482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-873c2045-dd66-424e-930f-3eb06077ab97 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:14.041212 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-873c2045-dd66-424e-930f-3eb06077ab97 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:14.079475 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-873c2045-dd66-424e-930f-3eb06077ab97 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments/7653f014-217b-4de4-be5e-e70d1279330c" status: 200 len: 194 microversion: 2.1 time: 0.061556 May 16 18:56:14.080129 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 477/939] 10.222.0.72 () {58 vars in 1412 bytes} [Mon May 16 18:56:14 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments/7653f014-217b-4de4-be5e-e70d1279330c => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:14.091007 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-26078e9c-71b6-419a-9f0c-25236a69d951 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:14.091787 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-26078e9c-71b6-419a-9f0c-25236a69d951 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:14.098773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-26078e9c-71b6-419a-9f0c-25236a69d951 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:14.099230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-26078e9c-71b6-419a-9f0c-25236a69d951 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:14.100051 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-26078e9c-71b6-419a-9f0c-25236a69d951 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:14.100488 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-26078e9c-71b6-419a-9f0c-25236a69d951 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:14.200995 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-26078e9c-71b6-419a-9f0c-25236a69d951 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lazy-loading 'services' on Instance uuid 4c93bb74-3b57-4277-9a6b-e8b7569f301d {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:56:14.282900 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-26078e9c-71b6-419a-9f0c-25236a69d951 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments/7653f014-217b-4de4-be5e-e70d1279330c" status: 202 len: 0 microversion: 2.1 time: 0.195878 May 16 18:56:14.284734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 463/940] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 18:56:14 2022] DELETE /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments/7653f014-217b-4de4-be5e-e70d1279330c => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 18:56:14.439424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2faa9a49-78a4-4156-ab50-d7d5f7765ab2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:14.440292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2faa9a49-78a4-4156-ab50-d7d5f7765ab2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:14.446870 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2faa9a49-78a4-4156-ab50-d7d5f7765ab2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:14.447323 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2faa9a49-78a4-4156-ab50-d7d5f7765ab2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:14.448301 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2faa9a49-78a4-4156-ab50-d7d5f7765ab2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:14.448744 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2faa9a49-78a4-4156-ab50-d7d5f7765ab2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:14.479736 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2faa9a49-78a4-4156-ab50-d7d5f7765ab2 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044384 May 16 18:56:14.480331 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 478/941] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:14 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 18:56:14.538593 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ecc4a679-2093-42f2-902d-b9ba66bebd62 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:14.539205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ecc4a679-2093-42f2-902d-b9ba66bebd62 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:14.545772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ecc4a679-2093-42f2-902d-b9ba66bebd62 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:14.546226 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ecc4a679-2093-42f2-902d-b9ba66bebd62 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:14.547004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ecc4a679-2093-42f2-902d-b9ba66bebd62 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:14.547440 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ecc4a679-2093-42f2-902d-b9ba66bebd62 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:14.573018 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ecc4a679-2093-42f2-902d-b9ba66bebd62 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:56:14.661513 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ecc4a679-2093-42f2-902d-b9ba66bebd62 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 204 len: 0 microversion: 2.1 time: 0.126954 May 16 18:56:14.661846 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 464/942] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:56:14 2022] DELETE /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:56:14.672023 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9564a4b5-15b1-42ab-9be6-016b9e7fcc32 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:14.672921 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9564a4b5-15b1-42ab-9be6-016b9e7fcc32 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:14.682903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9564a4b5-15b1-42ab-9be6-016b9e7fcc32 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:14.683359 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9564a4b5-15b1-42ab-9be6-016b9e7fcc32 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:14.684183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9564a4b5-15b1-42ab-9be6-016b9e7fcc32 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:14.684622 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9564a4b5-15b1-42ab-9be6-016b9e7fcc32 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:14.837456 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9564a4b5-15b1-42ab-9be6-016b9e7fcc32 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:14.845517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9564a4b5-15b1-42ab-9be6-016b9e7fcc32 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1680 microversion: 2.1 time: 0.178835 May 16 18:56:14.846092 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 479/943] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:14 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:15.863108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d898b068-85ce-4775-b84e-2592a4b32d9a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:15.864187 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d898b068-85ce-4775-b84e-2592a4b32d9a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:15.870940 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d898b068-85ce-4775-b84e-2592a4b32d9a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:15.871483 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d898b068-85ce-4775-b84e-2592a4b32d9a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:15.872381 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d898b068-85ce-4775-b84e-2592a4b32d9a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:15.872822 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d898b068-85ce-4775-b84e-2592a4b32d9a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:16.046473 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d898b068-85ce-4775-b84e-2592a4b32d9a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:16.065389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d898b068-85ce-4775-b84e-2592a4b32d9a tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1680 microversion: 2.1 time: 0.206312 May 16 18:56:16.075822 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 465/944] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:15 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1680 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:17.088695 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e30073c1-b4ba-433d-971b-3c763b825375 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:17.089865 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-e30073c1-b4ba-433d-971b-3c763b825375 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:17.101670 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e30073c1-b4ba-433d-971b-3c763b825375 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:17.102903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e30073c1-b4ba-433d-971b-3c763b825375 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:17.102903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e30073c1-b4ba-433d-971b-3c763b825375 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:17.103506 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e30073c1-b4ba-433d-971b-3c763b825375 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:17.336416 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-e30073c1-b4ba-433d-971b-3c763b825375 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:17.344403 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e30073c1-b4ba-433d-971b-3c763b825375 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1680 microversion: 2.1 time: 0.264430 May 16 18:56:17.345026 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 480/945] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:17 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:17.565381 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-98dd9e0d-16b6-4677-a614-860b5cbf0177 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:17.565945 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-98dd9e0d-16b6-4677-a614-860b5cbf0177 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:17.573377 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-98dd9e0d-16b6-4677-a614-860b5cbf0177 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:17.573826 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-98dd9e0d-16b6-4677-a614-860b5cbf0177 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:17.574599 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-98dd9e0d-16b6-4677-a614-860b5cbf0177 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:17.575045 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-98dd9e0d-16b6-4677-a614-860b5cbf0177 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:17.611428 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-98dd9e0d-16b6-4677-a614-860b5cbf0177 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments/82eb78c0-d848-4330-bfb4-d447a64ffe99" status: 200 len: 194 microversion: 2.1 time: 0.049940 May 16 18:56:17.612365 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 466/946] 10.222.0.72 () {58 vars in 1412 bytes} [Mon May 16 18:56:17 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments/82eb78c0-d848-4330-bfb4-d447a64ffe99 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:17.626189 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c4dc7634-7df9-4813-b808-57b28816e2ce tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:17.626733 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c4dc7634-7df9-4813-b808-57b28816e2ce tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:17.633744 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c4dc7634-7df9-4813-b808-57b28816e2ce tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:17.634187 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c4dc7634-7df9-4813-b808-57b28816e2ce tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:17.636281 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c4dc7634-7df9-4813-b808-57b28816e2ce tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:17.637039 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c4dc7634-7df9-4813-b808-57b28816e2ce tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:17.734014 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-c4dc7634-7df9-4813-b808-57b28816e2ce tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lazy-loading 'services' on Instance uuid 4c93bb74-3b57-4277-9a6b-e8b7569f301d {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:56:17.841115 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c4dc7634-7df9-4813-b808-57b28816e2ce tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments/82eb78c0-d848-4330-bfb4-d447a64ffe99" status: 202 len: 0 microversion: 2.1 time: 0.218802 May 16 18:56:17.842657 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 481/947] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 18:56:17 2022] DELETE /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments/82eb78c0-d848-4330-bfb4-d447a64ffe99 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:56:17.949150 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-e1e19178-89f1-4575-9273-f2d46e51f2f6 req-f2367dc2-668c-49b5-b9d5-b7747891c9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d5725-0fac-4ad5-942f-f74fdc9bfbfb", "name": "network-vif-deleted", "tag": "2a30c253-e8b1-4a46-acbb-8e869807dac0"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:56:17.958833 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-e1e19178-89f1-4575-9273-f2d46e51f2f6 req-f2367dc2-668c-49b5-b9d5-b7747891c9df service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:17.959342 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-e1e19178-89f1-4575-9273-f2d46e51f2f6 req-f2367dc2-668c-49b5-b9d5-b7747891c9df service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:17.975795 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-e1e19178-89f1-4575-9273-f2d46e51f2f6 req-f2367dc2-668c-49b5-b9d5-b7747891c9df service nova] Creating event network-vif-deleted:2a30c253-e8b1-4a46-acbb-8e869807dac0 for instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb on hv-cinder-75078 May 16 18:56:17.985552 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-e1e19178-89f1-4575-9273-f2d46e51f2f6 req-f2367dc2-668c-49b5-b9d5-b7747891c9df service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039865 May 16 18:56:17.990914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 467/948] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:18.368537 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:18.369764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:18.377094 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:18.377551 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:18.378335 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:18.378773 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:18.425362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:18.425771 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:18.427197 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lazy-loading 'fault' on Instance uuid 330d5725-0fac-4ad5-942f-f74fdc9bfbfb {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:56:18.488896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0d8acbe24d410690470e3d9d4882b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593c7b69cbad453499aacad0ad6e64ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:18.497627 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d6059430-9f25-49c0-a115-48b97c86eb16 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 200 len: 1330 microversion: 2.1 time: 0.136331 May 16 18:56:18.498225 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 482/949] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:18 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 1330 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:56:19.517685 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-36e12d28-0076-4639-bfe1-31a00df27c61 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:19.518378 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-36e12d28-0076-4639-bfe1-31a00df27c61 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:19.525095 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36e12d28-0076-4639-bfe1-31a00df27c61 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:19.525545 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36e12d28-0076-4639-bfe1-31a00df27c61 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:19.526331 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36e12d28-0076-4639-bfe1-31a00df27c61 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:19.526756 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-36e12d28-0076-4639-bfe1-31a00df27c61 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:19.540870 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-36e12d28-0076-4639-bfe1-31a00df27c61 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-36e12d28-0076-4639-bfe1-31a00df27c61 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb HTTP/1.1 May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:19.542382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:19.544004 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '330d5725-0fac-4ad5-942f-f74fdc9bfbfb'} May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:19.544904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:19.546359 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:19.547792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-36e12d28-0076-4639-bfe1-31a00df27c61 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:19.547792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-36e12d28-0076-4639-bfe1-31a00df27c61 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 404 len: 111 microversion: 2.1 time: 0.030892 May 16 18:56:19.547792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 468/950] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:19 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:19.554390 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-509ed650-d63e-4249-9f33-43d2833c5398 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '.version_select at 0x7f646cee59d0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:19.573575 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-509ed650-d63e-4249-9f33-43d2833c5398 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-930976190" status: 202 len: 0 microversion: 2.1 time: 0.024146 May 16 18:56:19.574182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 483/951] 10.222.0.72 () {58 vars in 1217 bytes} [Mon May 16 18:56:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-930976190 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:56:20.161300 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-07630add-7f59-441c-a28f-c9e63cd0db54 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:20.162265 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-07630add-7f59-441c-a28f-c9e63cd0db54 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:20.168730 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-07630add-7f59-441c-a28f-c9e63cd0db54 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:20.169178 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-07630add-7f59-441c-a28f-c9e63cd0db54 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:20.169957 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-07630add-7f59-441c-a28f-c9e63cd0db54 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:20.170541 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-07630add-7f59-441c-a28f-c9e63cd0db54 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:20.206733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-07630add-7f59-441c-a28f-c9e63cd0db54 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049971 May 16 18:56:20.214415 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 469/952] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:20 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 18:56:20.385815 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ae5671ea-7095-4fb8-b06b-f7bde95b0357 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:20.385815 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ae5671ea-7095-4fb8-b06b-f7bde95b0357 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:20.393614 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae5671ea-7095-4fb8-b06b-f7bde95b0357 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:20.394160 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae5671ea-7095-4fb8-b06b-f7bde95b0357 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:20.395293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae5671ea-7095-4fb8-b06b-f7bde95b0357 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:20.395687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae5671ea-7095-4fb8-b06b-f7bde95b0357 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:20.432186 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ae5671ea-7095-4fb8-b06b-f7bde95b0357 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054844 May 16 18:56:20.433223 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 484/953] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 18:56:20 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 18:56:20.500650 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-71e9d4c4-b1a7-417a-9824-47c262f4e255 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:20.501372 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-71e9d4c4-b1a7-417a-9824-47c262f4e255 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:20.512650 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-71e9d4c4-b1a7-417a-9824-47c262f4e255 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:20.513125 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-71e9d4c4-b1a7-417a-9824-47c262f4e255 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:20.514086 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-71e9d4c4-b1a7-417a-9824-47c262f4e255 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:20.514587 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-71e9d4c4-b1a7-417a-9824-47c262f4e255 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:20.550867 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-71e9d4c4-b1a7-417a-9824-47c262f4e255 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:56:20.665146 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-71e9d4c4-b1a7-417a-9824-47c262f4e255 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 204 len: 0 microversion: 2.1 time: 0.169751 May 16 18:56:20.666219 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 470/954] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:56:20 2022] DELETE /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:56:20.681922 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-50ed1395-62ec-4d85-9092-360d0c3cd0cf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:20.683089 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-50ed1395-62ec-4d85-9092-360d0c3cd0cf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:20.692873 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50ed1395-62ec-4d85-9092-360d0c3cd0cf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:20.693326 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50ed1395-62ec-4d85-9092-360d0c3cd0cf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:20.694121 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50ed1395-62ec-4d85-9092-360d0c3cd0cf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:20.694558 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50ed1395-62ec-4d85-9092-360d0c3cd0cf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:20.857566 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-50ed1395-62ec-4d85-9092-360d0c3cd0cf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:20.865777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-50ed1395-62ec-4d85-9092-360d0c3cd0cf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1672 microversion: 2.1 time: 0.192517 May 16 18:56:20.866464 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 485/955] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:20 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1672 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:21.504839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e49569bb-4fda-48e3-b35b-ba005a65fc6d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:21.505769 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e49569bb-4fda-48e3-b35b-ba005a65fc6d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:21.513592 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e49569bb-4fda-48e3-b35b-ba005a65fc6d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:21.514057 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e49569bb-4fda-48e3-b35b-ba005a65fc6d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:21.514869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e49569bb-4fda-48e3-b35b-ba005a65fc6d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:21.515300 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e49569bb-4fda-48e3-b35b-ba005a65fc6d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:21.531227 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-e49569bb-4fda-48e3-b35b-ba005a65fc6d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e49569bb-4fda-48e3-b35b-ba005a65fc6d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: DELETE /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb HTTP/1.1 May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:21.532939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:21.535310 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '330d5725-0fac-4ad5-942f-f74fdc9bfbfb'} May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:21.536924 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:21.539411 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:21.542087 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e49569bb-4fda-48e3-b35b-ba005a65fc6d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:21.542087 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e49569bb-4fda-48e3-b35b-ba005a65fc6d tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 404 len: 111 microversion: 2.1 time: 0.035306 May 16 18:56:21.542087 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 471/956] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:56:21 2022] DELETE /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:21.545286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-77f55739-d7a7-440d-8b71-26d1025052cc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:21.545900 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-77f55739-d7a7-440d-8b71-26d1025052cc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 330d5725-0fac-4ad5-942f-f74fdc9bfbfb] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:21.553284 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-77f55739-d7a7-440d-8b71-26d1025052cc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:21.553979 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-77f55739-d7a7-440d-8b71-26d1025052cc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:21.554789 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-77f55739-d7a7-440d-8b71-26d1025052cc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:21.555233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-77f55739-d7a7-440d-8b71-26d1025052cc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:21.571165 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-77f55739-d7a7-440d-8b71-26d1025052cc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-77f55739-d7a7-440d-8b71-26d1025052cc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb HTTP/1.1 May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:21.572760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:21.575685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '330d5725-0fac-4ad5-942f-f74fdc9bfbfb'} May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:21.577286 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. May 16 18:56:21.580183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:21.582820 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-77f55739-d7a7-440d-8b71-26d1025052cc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance 330d5725-0fac-4ad5-942f-f74fdc9bfbfb could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:21.582820 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-77f55739-d7a7-440d-8b71-26d1025052cc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb" status: 404 len: 111 microversion: 2.1 time: 0.034438 May 16 18:56:21.582820 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 486/957] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:21 2022] GET /compute/v2.1/servers/330d5725-0fac-4ad5-942f-f74fdc9bfbfb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 18:56:21.884375 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-62d8490b-1dd7-4f2c-a8aa-68c67556dfcf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:21.885151 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-62d8490b-1dd7-4f2c-a8aa-68c67556dfcf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:21.892860 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-62d8490b-1dd7-4f2c-a8aa-68c67556dfcf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:21.893408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-62d8490b-1dd7-4f2c-a8aa-68c67556dfcf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:21.894394 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-62d8490b-1dd7-4f2c-a8aa-68c67556dfcf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:21.895988 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-62d8490b-1dd7-4f2c-a8aa-68c67556dfcf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:22.072461 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-62d8490b-1dd7-4f2c-a8aa-68c67556dfcf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:22.083218 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-62d8490b-1dd7-4f2c-a8aa-68c67556dfcf tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1672 microversion: 2.1 time: 0.202507 May 16 18:56:22.083974 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 472/958] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:21 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:22.749190 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-19632dd9-d666-430a-950a-11f8e19cc059 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:22.749864 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-19632dd9-d666-430a-950a-11f8e19cc059 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:22.757604 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-19632dd9-d666-430a-950a-11f8e19cc059 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:22.758057 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-19632dd9-d666-430a-950a-11f8e19cc059 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:22.758852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-19632dd9-d666-430a-950a-11f8e19cc059 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:22.759293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-19632dd9-d666-430a-950a-11f8e19cc059 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:22.774369 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-19632dd9-d666-430a-950a-11f8e19cc059 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-19632dd9-d666-430a-950a-11f8e19cc059 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: DELETE /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 HTTP/1.1 May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:22.776008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:56:22.777545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'bce01de2-ca20-437e-93cb-975e3add0542'} May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:22.778424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:56:22.779867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:22.781265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-19632dd9-d666-430a-950a-11f8e19cc059 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:22.781265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-19632dd9-d666-430a-950a-11f8e19cc059 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 404 len: 111 microversion: 2.1 time: 0.035178 May 16 18:56:22.781265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 487/959] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:56:22 2022] DELETE /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:22.787031 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2005ec77-b40c-4a51-a7b2-f26ad5d8b033 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:22.787652 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2005ec77-b40c-4a51-a7b2-f26ad5d8b033 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: bce01de2-ca20-437e-93cb-975e3add0542] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:22.794379 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2005ec77-b40c-4a51-a7b2-f26ad5d8b033 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:22.794835 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2005ec77-b40c-4a51-a7b2-f26ad5d8b033 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:22.795672 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2005ec77-b40c-4a51-a7b2-f26ad5d8b033 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:22.796162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2005ec77-b40c-4a51-a7b2-f26ad5d8b033 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:22.820184 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-2005ec77-b40c-4a51-a7b2-f26ad5d8b033 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2005ec77-b40c-4a51-a7b2-f26ad5d8b033 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 HTTP/1.1 May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:22.822717 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:56:22.825353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': 'bce01de2-ca20-437e-93cb-975e3add0542'} May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:22.826380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. May 16 18:56:22.828353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:22.830165 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2005ec77-b40c-4a51-a7b2-f26ad5d8b033 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance bce01de2-ca20-437e-93cb-975e3add0542 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:22.830165 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2005ec77-b40c-4a51-a7b2-f26ad5d8b033 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542" status: 404 len: 111 microversion: 2.1 time: 0.042219 May 16 18:56:22.830165 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 473/960] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:22 2022] GET /compute/v2.1/servers/bce01de2-ca20-437e-93cb-975e3add0542 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:22.835855 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-be628a6e-34b8-4b36-9180-a8810f335ddd tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:22.836352 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-be628a6e-34b8-4b36-9180-a8810f335ddd tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:22.843287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be628a6e-34b8-4b36-9180-a8810f335ddd tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:22.843767 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be628a6e-34b8-4b36-9180-a8810f335ddd tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:22.844551 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be628a6e-34b8-4b36-9180-a8810f335ddd tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:22.844980 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-be628a6e-34b8-4b36-9180-a8810f335ddd tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:22.860777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-be628a6e-34b8-4b36-9180-a8810f335ddd tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-be628a6e-34b8-4b36-9180-a8810f335ddd tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: DELETE /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 HTTP/1.1 May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:22.862361 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:56:22.864117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '2b6715a3-0274-463c-b6e5-4116112ef2c9'} May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:22.864832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:56:22.866166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:22.867559 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-be628a6e-34b8-4b36-9180-a8810f335ddd tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:22.867559 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-be628a6e-34b8-4b36-9180-a8810f335ddd tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 404 len: 111 microversion: 2.1 time: 0.032778 May 16 18:56:22.867559 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 488/961] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:56:22 2022] DELETE /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:22.874591 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4215e178-d283-45ba-af07-27bdd5759462 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:22.875509 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4215e178-d283-45ba-af07-27bdd5759462 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: 2b6715a3-0274-463c-b6e5-4116112ef2c9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:22.882680 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4215e178-d283-45ba-af07-27bdd5759462 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:22.883146 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4215e178-d283-45ba-af07-27bdd5759462 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:22.883972 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4215e178-d283-45ba-af07-27bdd5759462 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:22.884416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4215e178-d283-45ba-af07-27bdd5759462 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:22.912987 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-4215e178-d283-45ba-af07-27bdd5759462 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4215e178-d283-45ba-af07-27bdd5759462 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 HTTP/1.1 May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:22.914839 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:56:22.917477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '2b6715a3-0274-463c-b6e5-4116112ef2c9'} May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:22.918942 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. May 16 18:56:22.920465 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:22.922418 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4215e178-d283-45ba-af07-27bdd5759462 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance 2b6715a3-0274-463c-b6e5-4116112ef2c9 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:22.922418 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4215e178-d283-45ba-af07-27bdd5759462 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9" status: 404 len: 111 microversion: 2.1 time: 0.047517 May 16 18:56:22.922995 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 474/962] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:22 2022] GET /compute/v2.1/servers/2b6715a3-0274-463c-b6e5-4116112ef2c9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:23.106582 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8cc40544-3e03-4231-9f65-4d34028581bc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:23.108090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8cc40544-3e03-4231-9f65-4d34028581bc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:23.119305 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8cc40544-3e03-4231-9f65-4d34028581bc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:23.120192 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8cc40544-3e03-4231-9f65-4d34028581bc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:23.121421 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8cc40544-3e03-4231-9f65-4d34028581bc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:23.121636 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8cc40544-3e03-4231-9f65-4d34028581bc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:23.385196 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8cc40544-3e03-4231-9f65-4d34028581bc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:23.392592 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8cc40544-3e03-4231-9f65-4d34028581bc tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1672 microversion: 2.1 time: 0.290996 May 16 18:56:23.393174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 489/963] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:23 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1672 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:23.889683 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-4b25e04a-615a-4073-ac7d-a73bb248a95c req-bb05f333-dd1a-4f7f-bdfe-f78f50a63c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c93bb74-3b57-4277-9a6b-e8b7569f301d", "name": "network-vif-deleted", "tag": "2c309251-7e9b-443c-b897-9cf5b018f4b9"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:56:23.916511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-4b25e04a-615a-4073-ac7d-a73bb248a95c req-bb05f333-dd1a-4f7f-bdfe-f78f50a63c01 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:23.918170 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-4b25e04a-615a-4073-ac7d-a73bb248a95c req-bb05f333-dd1a-4f7f-bdfe-f78f50a63c01 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:23.937423 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-4b25e04a-615a-4073-ac7d-a73bb248a95c req-bb05f333-dd1a-4f7f-bdfe-f78f50a63c01 service nova] Creating event network-vif-deleted:2c309251-7e9b-443c-b897-9cf5b018f4b9 for instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d on hv-cinder-75078 May 16 18:56:23.943648 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-4b25e04a-615a-4073-ac7d-a73bb248a95c req-bb05f333-dd1a-4f7f-bdfe-f78f50a63c01 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064425 May 16 18:56:23.945119 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 475/964] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:24.102306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-960f24ae-5d02-47af-8a79-75e17a51bcb6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:24.103959 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-960f24ae-5d02-47af-8a79-75e17a51bcb6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:24.112672 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-960f24ae-5d02-47af-8a79-75e17a51bcb6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:24.114037 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-960f24ae-5d02-47af-8a79-75e17a51bcb6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:24.115503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-960f24ae-5d02-47af-8a79-75e17a51bcb6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:24.116192 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-960f24ae-5d02-47af-8a79-75e17a51bcb6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:24.135123 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-960f24ae-5d02-47af-8a79-75e17a51bcb6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-960f24ae-5d02-47af-8a79-75e17a51bcb6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: DELETE /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 HTTP/1.1 May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:24.137239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:56:24.139509 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'ec82e115-5ca8-47de-ba42-405096ec5d98'} May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:24.140828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:56:24.143546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:24.145711 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-960f24ae-5d02-47af-8a79-75e17a51bcb6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:24.145711 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-960f24ae-5d02-47af-8a79-75e17a51bcb6 tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 404 len: 111 microversion: 2.1 time: 0.043501 May 16 18:56:24.145711 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 490/965] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:56:24 2022] DELETE /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:24.148904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f624bdde-dd77-4a08-8a97-716f50ec53fc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:24.149597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f624bdde-dd77-4a08-8a97-716f50ec53fc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] [instance: ec82e115-5ca8-47de-ba42-405096ec5d98] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:24.159178 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f624bdde-dd77-4a08-8a97-716f50ec53fc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:24.159633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f624bdde-dd77-4a08-8a97-716f50ec53fc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:24.160770 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f624bdde-dd77-4a08-8a97-716f50ec53fc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:24.161328 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f624bdde-dd77-4a08-8a97-716f50ec53fc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:24.176258 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-f624bdde-dd77-4a08-8a97-716f50ec53fc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] HTTP exception thrown: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f624bdde-dd77-4a08-8a97-716f50ec53fc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Request method failure captured: May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 HTTP/1.1 May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyJPko-WIJinmYuRQDsurybQaAtUkfE8tvQhBBtHVLvci6gHYXftjjOA-3V3qtbnxsdZyXG7QFfa__nXfnnPKEjK476tGBk5A5ezNtZPJtkpk3nlI6e9JHCiUdsaZK5m5pNolPSCqOvW000OtNEXxO8Chri0gOkfcNCrWhDtZOEk-E May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:24.178161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/593c7b69cbad453499aacad0ad6e64ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 593c7b69cbad453499aacad0ad6e64ae May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2130706637 May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: cd0d8acbe24d410690470e3d9d4882b1 May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeNegativeTest-2130706637-project May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:56:24.181222 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': 'ec82e115-5ca8-47de-ba42-405096ec5d98'} May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:24.182800 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. May 16 18:56:24.185500 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:24.188330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f624bdde-dd77-4a08-8a97-716f50ec53fc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] Returning 404 to user: Instance ec82e115-5ca8-47de-ba42-405096ec5d98 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:24.188330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f624bdde-dd77-4a08-8a97-716f50ec53fc tempest-AttachVolumeNegativeTest-2130706637 tempest-AttachVolumeNegativeTest-2130706637-project] 10.222.0.72 "GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98" status: 404 len: 111 microversion: 2.1 time: 0.035927 May 16 18:56:24.188330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 476/966] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:24 2022] GET /compute/v2.1/servers/ec82e115-5ca8-47de-ba42-405096ec5d98 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:24.413467 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:24.414919 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:24.430616 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:24.432554 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:24.435741 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:24.437093 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:24.509140 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:24.510048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:24.510665 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lazy-loading 'fault' on Instance uuid 4c93bb74-3b57-4277-9a6b-e8b7569f301d {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:56:24.608205 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab7aa55b2554d338cd76f34d03e1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d882994e2c443fb1d9104ccbfb8c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:24.627853 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-bf09a6bb-e67e-4ebf-8c8e-ee2850fd4f31 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 200 len: 1327 microversion: 2.1 time: 0.221589 May 16 18:56:24.629778 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 491/967] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:24 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 1327 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:25.648963 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4212a9d1-3b40-41f9-b407-55f807f9ec20 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:25.649694 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4212a9d1-3b40-41f9-b407-55f807f9ec20 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:25.657278 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4212a9d1-3b40-41f9-b407-55f807f9ec20 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:25.657735 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4212a9d1-3b40-41f9-b407-55f807f9ec20 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:25.658523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4212a9d1-3b40-41f9-b407-55f807f9ec20 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:25.659161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4212a9d1-3b40-41f9-b407-55f807f9ec20 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:25.674827 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-4212a9d1-3b40-41f9-b407-55f807f9ec20 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] HTTP exception thrown: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4212a9d1-3b40-41f9-b407-55f807f9ec20 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Request method failure captured: May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d HTTP/1.1 May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyNik-rBQNygEkPA8ejxpR78IavGzTPEzAL8TaxfAsdBa4-LFUgZeeUnXRBxE5HNtDKbcg_P2LHSqzLVS74-YiQFXdtrxtuHuelTaeRpiEr5qaCLfpSfQzNpwtdEmlV8-Esiozgpp_13vkx54wlvxTN2to1PLT5Mz3UEIIi8PcCxUE May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:25.676433 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: dab7aa55b2554d338cd76f34d03e1ef2 May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:25.677889 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '4c93bb74-3b57-4277-9a6b-e8b7569f301d'} May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:25.678733 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:25.680034 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:25.681150 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4212a9d1-3b40-41f9-b407-55f807f9ec20 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Returning 404 to user: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:25.681150 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4212a9d1-3b40-41f9-b407-55f807f9ec20 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 404 len: 111 microversion: 2.1 time: 0.033941 May 16 18:56:25.681150 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 477/968] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:25 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:25.686974 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-621a91db-44c1-4c66-87d2-fdc43fcc6b57 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '.version_select at 0x7f646cf36040>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:25.705391 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-621a91db-44c1-4c66-87d2-fdc43fcc6b57 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-180807774" status: 202 len: 0 microversion: 2.1 time: 0.022049 May 16 18:56:25.705812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 492/969] 10.222.0.72 () {58 vars in 1217 bytes} [Mon May 16 18:56:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-180807774 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:56:29.152760 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-50f58cf1-e051-4b7f-8a63-4a3da298238a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:29.153810 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-50f58cf1-e051-4b7f-8a63-4a3da298238a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:29.165568 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-50f58cf1-e051-4b7f-8a63-4a3da298238a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:29.166170 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-50f58cf1-e051-4b7f-8a63-4a3da298238a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:29.167559 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-50f58cf1-e051-4b7f-8a63-4a3da298238a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:29.168394 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-50f58cf1-e051-4b7f-8a63-4a3da298238a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:29.186688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-50f58cf1-e051-4b7f-8a63-4a3da298238a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] HTTP exception thrown: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-50f58cf1-e051-4b7f-8a63-4a3da298238a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Request method failure captured: May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: DELETE /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d HTTP/1.1 May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyNik-rBQNygEkPA8ejxpR78IavGzTPEzAL8TaxfAsdBa4-LFUgZeeUnXRBxE5HNtDKbcg_P2LHSqzLVS74-YiQFXdtrxtuHuelTaeRpiEr5qaCLfpSfQzNpwtdEmlV8-Esiozgpp_13vkx54wlvxTN2to1PLT5Mz3UEIIi8PcCxUE May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:29.188313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: dab7aa55b2554d338cd76f34d03e1ef2 May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:29.190063 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '4c93bb74-3b57-4277-9a6b-e8b7569f301d'} May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:29.191869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:29.193932 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:29.196436 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-50f58cf1-e051-4b7f-8a63-4a3da298238a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Returning 404 to user: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:29.196436 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-50f58cf1-e051-4b7f-8a63-4a3da298238a tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 404 len: 111 microversion: 2.1 time: 0.046649 May 16 18:56:29.196436 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 478/970] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:56:29 2022] DELETE /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:29.201121 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2d9e07d9-5083-4724-bd1c-a39d4237aab9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:29.201780 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2d9e07d9-5083-4724-bd1c-a39d4237aab9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: 4c93bb74-3b57-4277-9a6b-e8b7569f301d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:29.211495 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2d9e07d9-5083-4724-bd1c-a39d4237aab9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:29.212032 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2d9e07d9-5083-4724-bd1c-a39d4237aab9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:29.213033 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2d9e07d9-5083-4724-bd1c-a39d4237aab9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:29.213485 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2d9e07d9-5083-4724-bd1c-a39d4237aab9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:29.229716 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-2d9e07d9-5083-4724-bd1c-a39d4237aab9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] HTTP exception thrown: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2d9e07d9-5083-4724-bd1c-a39d4237aab9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Request method failure captured: May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d HTTP/1.1 May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyNik-rBQNygEkPA8ejxpR78IavGzTPEzAL8TaxfAsdBa4-LFUgZeeUnXRBxE5HNtDKbcg_P2LHSqzLVS74-YiQFXdtrxtuHuelTaeRpiEr5qaCLfpSfQzNpwtdEmlV8-Esiozgpp_13vkx54wlvxTN2to1PLT5Mz3UEIIi8PcCxUE May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:29.231287 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: dab7aa55b2554d338cd76f34d03e1ef2 May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:29.234191 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '4c93bb74-3b57-4277-9a6b-e8b7569f301d'} May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:29.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. May 16 18:56:29.239338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:29.241736 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2d9e07d9-5083-4724-bd1c-a39d4237aab9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Returning 404 to user: Instance 4c93bb74-3b57-4277-9a6b-e8b7569f301d could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:29.241736 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2d9e07d9-5083-4724-bd1c-a39d4237aab9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d" status: 404 len: 111 microversion: 2.1 time: 0.036613 May 16 18:56:29.241736 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 493/971] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:29 2022] GET /compute/v2.1/servers/4c93bb74-3b57-4277-9a6b-e8b7569f301d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:30.445664 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3bfd6ed0-90ff-4402-bad2-25b05d615cf9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:30.446537 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-3bfd6ed0-90ff-4402-bad2-25b05d615cf9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:30.455449 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3bfd6ed0-90ff-4402-bad2-25b05d615cf9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:30.455927 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3bfd6ed0-90ff-4402-bad2-25b05d615cf9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:30.456861 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3bfd6ed0-90ff-4402-bad2-25b05d615cf9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:30.457296 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3bfd6ed0-90ff-4402-bad2-25b05d615cf9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:30.474398 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-3bfd6ed0-90ff-4402-bad2-25b05d615cf9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] HTTP exception thrown: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3bfd6ed0-90ff-4402-bad2-25b05d615cf9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Request method failure captured: May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: DELETE /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 HTTP/1.1 May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyNik-rBQNygEkPA8ejxpR78IavGzTPEzAL8TaxfAsdBa4-LFUgZeeUnXRBxE5HNtDKbcg_P2LHSqzLVS74-YiQFXdtrxtuHuelTaeRpiEr5qaCLfpSfQzNpwtdEmlV8-Esiozgpp_13vkx54wlvxTN2to1PLT5Mz3UEIIi8PcCxUE May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:30.476205 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: dab7aa55b2554d338cd76f34d03e1ef2 May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:56:30.477744 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': 'bd5e49a3-f392-4cd6-9856-4b5367c2d5e2'} May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:30.478514 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:56:30.479734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:30.481019 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3bfd6ed0-90ff-4402-bad2-25b05d615cf9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Returning 404 to user: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:30.481019 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3bfd6ed0-90ff-4402-bad2-25b05d615cf9 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 404 len: 111 microversion: 2.1 time: 0.048744 May 16 18:56:30.481019 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 479/972] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:56:30 2022] DELETE /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 18:56:30.486697 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bb415fb8-b3fb-424d-9d39-786e64011496 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:30.487325 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-bb415fb8-b3fb-424d-9d39-786e64011496 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] [instance: bd5e49a3-f392-4cd6-9856-4b5367c2d5e2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:30.494974 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bb415fb8-b3fb-424d-9d39-786e64011496 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:30.494974 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bb415fb8-b3fb-424d-9d39-786e64011496 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:30.496365 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bb415fb8-b3fb-424d-9d39-786e64011496 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:30.496950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bb415fb8-b3fb-424d-9d39-786e64011496 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:30.512102 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-bb415fb8-b3fb-424d-9d39-786e64011496 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] HTTP exception thrown: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bb415fb8-b3fb-424d-9d39-786e64011496 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Request method failure captured: May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 HTTP/1.1 May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyNik-rBQNygEkPA8ejxpR78IavGzTPEzAL8TaxfAsdBa4-LFUgZeeUnXRBxE5HNtDKbcg_P2LHSqzLVS74-YiQFXdtrxtuHuelTaeRpiEr5qaCLfpSfQzNpwtdEmlV8-Esiozgpp_13vkx54wlvxTN2to1PLT5Mz3UEIIi8PcCxUE May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:30.513634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75d882994e2c443fb1d9104ccbfb8c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 75d882994e2c443fb1d9104ccbfb8c7f May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1298286979 May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: dab7aa55b2554d338cd76f34d03e1ef2 May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeTestJSON-1298286979-project May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:56:30.515451 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'bd5e49a3-f392-4cd6-9856-4b5367c2d5e2'} May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:30.516818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. May 16 18:56:30.518211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:30.520373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bb415fb8-b3fb-424d-9d39-786e64011496 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] Returning 404 to user: Instance bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:30.520373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-bb415fb8-b3fb-424d-9d39-786e64011496 tempest-AttachVolumeTestJSON-1298286979 tempest-AttachVolumeTestJSON-1298286979-project] 10.222.0.72 "GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2" status: 404 len: 111 microversion: 2.1 time: 0.032333 May 16 18:56:30.520373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 494/973] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:30 2022] GET /compute/v2.1/servers/bd5e49a3-f392-4cd6-9856-4b5367c2d5e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 18:56:31.912372 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-fc3fe705-61bf-4834-ae96-7be8e6aed647 tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f64684dc940>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:32.007841 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-fc3fe705-61bf-4834-ae96-7be8e6aed647 tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/47120da6-393d-4558-95a4-1ceff2ff8205" status: 200 len: 351 microversion: 2.1 time: 0.101120 May 16 18:56:32.010077 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 480/974] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:56:31 2022] GET /compute/v2.1/os-volumes/47120da6-393d-4558-95a4-1ceff2ff8205 => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:33.468837 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8ed9d2ca-dc37-4fec-b440-d04f3846245e tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f646ceeb700>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:33.530749 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8ed9d2ca-dc37-4fec-b440-d04f3846245e tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5a8e846b-1f51-4315-a7f3-a38ea6fde617" status: 200 len: 349 microversion: 2.1 time: 0.066684 May 16 18:56:33.531319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 495/975] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:56:33 2022] GET /compute/v2.1/os-volumes/5a8e846b-1f51-4315-a7f3-a38ea6fde617 => generated 349 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:34.821746 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f5e47202-7a17-4073-9300-7c28a036b5a7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:34.823009 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f5e47202-7a17-4073-9300-7c28a036b5a7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:34.837493 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-60062c6c-dcdd-44dc-a6db-fcdd338fb1e5 req-53678c69-ddae-4d44-8566-094f39814fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12aa2a80-3944-4ff6-9b34-ada2debe18c5", "tag": "fbd9282a-e554-4f50-b165-7ce5f6ec3daa"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:56:34.855075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-60062c6c-dcdd-44dc-a6db-fcdd338fb1e5 req-53678c69-ddae-4d44-8566-094f39814fbb service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:34.855764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-60062c6c-dcdd-44dc-a6db-fcdd338fb1e5 req-53678c69-ddae-4d44-8566-094f39814fbb service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:34.862971 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f5e47202-7a17-4073-9300-7c28a036b5a7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:34.862971 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f5e47202-7a17-4073-9300-7c28a036b5a7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:34.864536 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f5e47202-7a17-4073-9300-7c28a036b5a7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:34.865145 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f5e47202-7a17-4073-9300-7c28a036b5a7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:34.891618 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-60062c6c-dcdd-44dc-a6db-fcdd338fb1e5 req-53678c69-ddae-4d44-8566-094f39814fbb service nova] Creating event network-changed:fbd9282a-e554-4f50-b165-7ce5f6ec3daa for instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 on hv-cinder-75078 May 16 18:56:34.905164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-60062c6c-dcdd-44dc-a6db-fcdd338fb1e5 req-53678c69-ddae-4d44-8566-094f39814fbb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074746 May 16 18:56:34.905765 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 496/976] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:34.926920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f5e47202-7a17-4073-9300-7c28a036b5a7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:56:35.067206 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-144d74d9-ab1f-4bd9-b5c5-b7aea115c164 tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f646ceca1f0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:35.098246 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f5e47202-7a17-4073-9300-7c28a036b5a7 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "DELETE /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 204 len: 0 microversion: 2.1 time: 0.279617 May 16 18:56:35.100570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 481/977] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:56:34 2022] DELETE /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:56:35.118225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-698c3baf-3351-458b-b157-c778af89d755 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:35.119599 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-698c3baf-3351-458b-b157-c778af89d755 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:35.140749 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-698c3baf-3351-458b-b157-c778af89d755 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:35.141741 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-698c3baf-3351-458b-b157-c778af89d755 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:35.143137 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-698c3baf-3351-458b-b157-c778af89d755 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:35.152686 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-698c3baf-3351-458b-b157-c778af89d755 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:35.204444 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-144d74d9-ab1f-4bd9-b5c5-b7aea115c164 tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/d000905e-ac54-4834-995a-a4db9104930d" status: 200 len: 351 microversion: 2.1 time: 0.144077 May 16 18:56:35.205629 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 497/978] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:56:35 2022] GET /compute/v2.1/os-volumes/d000905e-ac54-4834-995a-a4db9104930d => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:56:35.223220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3d02e976-6e97-4967-8fae-c3df88909017 tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f646ceab430>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:35.381704 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3d02e976-6e97-4967-8fae-c3df88909017 tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.164891 May 16 18:56:35.382963 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 498/979] 10.222.0.72 () {58 vars in 1133 bytes} [Mon May 16 18:56:35 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:56:35.400401 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7e8a4f1e-c680-4369-9a25-c23ac8899ba3 tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f646cef0550>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:35.484435 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-698c3baf-3351-458b-b157-c778af89d755 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:35.499966 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-698c3baf-3351-458b-b157-c778af89d755 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.393089 May 16 18:56:35.501421 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 482/980] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:35 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:35.548234 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7e8a4f1e-c680-4369-9a25-c23ac8899ba3 tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.154125 May 16 18:56:35.549637 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 499/981] 10.222.0.72 () {58 vars in 1148 bytes} [Mon May 16 18:56:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:35.563069 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-55f798a1-8cf0-47dc-af8b-2b09b23cc2ea tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f6468432940>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:35.742153 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-55f798a1-8cf0-47dc-af8b-2b09b23cc2ea tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.182765 May 16 18:56:35.742816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 483/982] 10.222.0.72 () {58 vars in 1133 bytes} [Mon May 16 18:56:35 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:35.759293 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d61c315f-cea4-4da6-a65d-a3769a4127ec tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f646ce92160>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:35.880407 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d61c315f-cea4-4da6-a65d-a3769a4127ec tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.125694 May 16 18:56:35.881150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 500/983] 10.222.0.72 () {58 vars in 1166 bytes} [Mon May 16 18:56:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:56:35.897715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b9e84bea-2d59-4178-b885-a55fa92ba64e tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f64684110d0>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:36.051874 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b9e84bea-2d59-4178-b885-a55fa92ba64e tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.161241 May 16 18:56:36.052521 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 484/984] 10.222.0.72 () {58 vars in 1169 bytes} [Mon May 16 18:56:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:36.065717 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d62cf9b7-52a0-45cf-ab9d-170eb4bd0306 tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f646ceca9d0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:36.190687 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d62cf9b7-52a0-45cf-ab9d-170eb4bd0306 tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.129478 May 16 18:56:36.192124 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 501/985] 10.222.0.72 () {58 vars in 1154 bytes} [Mon May 16 18:56:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:36.208245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d295b144-a2cf-45d3-994b-11c2b5ee99cc tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f64684365e0>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:36.330534 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d295b144-a2cf-45d3-994b-11c2b5ee99cc tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.127592 May 16 18:56:36.330534 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 485/986] 10.222.0.72 () {58 vars in 1187 bytes} [Mon May 16 18:56:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:36.346120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5a43e48e-3b40-4a8e-abfc-7ea9b9a2007a tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] Calling method '.version_select at 0x7f646cef0b80>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:36.480288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5a43e48e-3b40-4a8e-abfc-7ea9b9a2007a tempest-VolumesTestJSON-145374651 tempest-VolumesTestJSON-145374651-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.137947 May 16 18:56:36.480927 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 502/987] 10.222.0.72 () {58 vars in 1154 bytes} [Mon May 16 18:56:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:36.525842 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-489bcb91-7f8e-4eb4-8d4d-33d0a7fe5651 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:36.527290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-489bcb91-7f8e-4eb4-8d4d-33d0a7fe5651 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:36.546404 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-489bcb91-7f8e-4eb4-8d4d-33d0a7fe5651 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:36.548336 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-489bcb91-7f8e-4eb4-8d4d-33d0a7fe5651 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:36.549786 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-489bcb91-7f8e-4eb4-8d4d-33d0a7fe5651 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:36.551899 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-489bcb91-7f8e-4eb4-8d4d-33d0a7fe5651 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:36.758509 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-489bcb91-7f8e-4eb4-8d4d-33d0a7fe5651 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:36.768935 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-489bcb91-7f8e-4eb4-8d4d-33d0a7fe5651 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1570 microversion: 2.1 time: 0.251356 May 16 18:56:36.772316 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 486/988] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:36 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1570 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:37.787033 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e291bb0f-c210-4eef-b409-704bf19249c0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:37.787770 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e291bb0f-c210-4eef-b409-704bf19249c0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:37.788393 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f82acd50-6400-44ce-bd97-6595c61571bd tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Action: 'create', calling method: .version_select at 0x7f646cecaee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-330631175", "metadata": {"Type": "work"}}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:56:37.806345 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e291bb0f-c210-4eef-b409-704bf19249c0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:37.806951 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e291bb0f-c210-4eef-b409-704bf19249c0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f82acd50-6400-44ce-bd97-6595c61571bd tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Request method failure captured: May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 121 May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigp5lNAtJXiq9L_BzZFkqQKzt7Q7CkCINWFgtRvQTHi6-E3lz9GbATtXlPw3F6PpnxQqTOLhrifejqXy0NqULF4Y66Fl-Ne-5zkBVXBohYOpsRz-eGpfCMWYVZJGy8ePw4kATIA3S2Clhe39DR-y9MlNDSwxrizx3LDuY_vUsu4_KuJk May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:37.807971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 31b47f666fb945428ddb9aa0672bc8db May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-330631175", "metadata": {"Type": "work"}}} May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: May 16 18:56:37.809353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-330631175', 'metadata': {'Type': 'work'}}}} May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise error May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi '#$%' May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:37.810150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 18:56:37.811488 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 18:56:37.818764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 18:56:37.818764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.818764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f82acd50-6400-44ce-bd97-6595c61571bd tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:37.818764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f82acd50-6400-44ce-bd97-6595c61571bd tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.207947 May 16 18:56:37.818764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 503/989] 10.222.0.72 () {60 vars in 1155 bytes} [Mon May 16 18:56:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 18:56:37.823623 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e291bb0f-c210-4eef-b409-704bf19249c0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:37.823623 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e291bb0f-c210-4eef-b409-704bf19249c0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:37.824808 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b48c5f86-6c96-4077-aa3f-a0cec6724a39 tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Action: 'create', calling method: .version_select at 0x7f646cee5670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-490844894", "metadata": {"Type": "work"}}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b48c5f86-6c96-4077-aa3f-a0cec6724a39 tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Request method failure captured: May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 119 May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigp5lNAtJXiq9L_BzZFkqQKzt7Q7CkCINWFgtRvQTHi6-E3lz9GbATtXlPw3F6PpnxQqTOLhrifejqXy0NqULF4Y66Fl-Ne-5zkBVXBohYOpsRz-eGpfCMWYVZJGy8ePw4kATIA3S2Clhe39DR-y9MlNDSwxrizx3LDuY_vUsu4_KuJk May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:37.828054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 31b47f666fb945428ddb9aa0672bc8db May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-490844894", "metadata": {"Type": "work"}}} May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: May 16 18:56:37.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-490844894', 'metadata': {'Type': 'work'}}}} May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise error May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi '0' May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:37.835619 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 18:56:37.837046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 18:56:37.838759 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 18:56:37.838759 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.838759 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-b48c5f86-6c96-4077-aa3f-a0cec6724a39 tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:37.838759 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-b48c5f86-6c96-4077-aa3f-a0cec6724a39 tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008421 May 16 18:56:37.838759 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 504/990] 10.222.0.72 () {60 vars in 1155 bytes} [Mon May 16 18:56:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 18:56:37.845151 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7387a686-1df2-41cb-a12a-2c903bc7166b tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Action: 'create', calling method: .version_select at 0x7f646cf36ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2066718442", "metadata": {"Type": "work"}}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7387a686-1df2-41cb-a12a-2c903bc7166b tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Request method failure captured: May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 119 May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigp5lNAtJXiq9L_BzZFkqQKzt7Q7CkCINWFgtRvQTHi6-E3lz9GbATtXlPw3F6PpnxQqTOLhrifejqXy0NqULF4Y66Fl-Ne-5zkBVXBohYOpsRz-eGpfCMWYVZJGy8ePw4kATIA3S2Clhe39DR-y9MlNDSwxrizx3LDuY_vUsu4_KuJk May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:37.848136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 31b47f666fb945428ddb9aa0672bc8db May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2066718442", "metadata": {"Type": "work"}}} May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: May 16 18:56:37.849436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2066718442', 'metadata': {'Type': 'work'}}}} May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise error May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi '' May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:37.850269 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 18:56:37.852659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 18:56:37.856477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 18:56:37.856477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.856477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7387a686-1df2-41cb-a12a-2c903bc7166b tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:37.856477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7387a686-1df2-41cb-a12a-2c903bc7166b tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013318 May 16 18:56:37.856477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 505/991] 10.222.0.72 () {60 vars in 1155 bytes} [Mon May 16 18:56:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 18:56:37.866634 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0ac26c04-034d-4761-9e07-2a1329b2dca4 tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Calling method '.version_select at 0x7f646cfb9670>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:37.952493 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-0ac26c04-034d-4761-9e07-2a1329b2dca4 tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] HTTP exception thrown: Volume tempest-invalid-1680773679 could not be found. May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0ac26c04-034d-4761-9e07-2a1329b2dca4 tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Request method failure captured: May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1680773679 HTTP/1.1 May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigp5lNAtJXiq9L_BzZFkqQKzt7Q7CkCINWFgtRvQTHi6-E3lz9GbATtXlPw3F6PpnxQqTOLhrifejqXy0NqULF4Y66Fl-Ne-5zkBVXBohYOpsRz-eGpfCMWYVZJGy8ePw4kATIA3S2Clhe39DR-y9MlNDSwxrizx3LDuY_vUsu4_KuJk May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:37.954701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 31b47f666fb945428ddb9aa0672bc8db May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Volume tempest-invalid-1680773679 could not be found. May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'tempest-invalid-1680773679'} May 16 18:56:37.957313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1680773679 could not be found. (HTTP 404) (Request-ID: req-ec04b652-753f-4f5a-a91a-04d7ff9cda80) May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:37.959120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 18:56:37.961411 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1680773679 could not be found. May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:37.963069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1680773679 could not be found. May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1680773679 could not be found. May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0ac26c04-034d-4761-9e07-2a1329b2dca4 tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Returning 404 to user: Volume tempest-invalid-1680773679 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0ac26c04-034d-4761-9e07-2a1329b2dca4 tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1680773679" status: 404 len: 99 microversion: 2.1 time: 0.098533 May 16 18:56:37.964647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 506/992] 10.222.0.72 () {58 vars in 1217 bytes} [Mon May 16 18:56:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1680773679 => generated 99 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 16 18:56:37.969529 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0c145df7-38dc-4e24-98f9-1e02067acfcd tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005014 May 16 18:56:37.970059 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 507/993] 10.222.0.72 () {58 vars in 1139 bytes} [Mon May 16 18:56:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 16 18:56:37.981164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-dc40ef21-9a8b-47f6-b634-7146a52873ca tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004078 May 16 18:56:37.982002 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 508/994] 10.222.0.72 () {58 vars in 1136 bytes} [Mon May 16 18:56:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 18:56:37.998105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-598a7d78-8187-4cf1-a4f0-dbf6efabc05c tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Calling method '.version_select at 0x7f646cf2f8b0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:38.032933 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-598a7d78-8187-4cf1-a4f0-dbf6efabc05c tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] HTTP exception thrown: Volume eb0c3903-9a09-485b-b6f9-aced81233629 could not be found. May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-598a7d78-8187-4cf1-a4f0-dbf6efabc05c tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Request method failure captured: May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: DELETE /compute/v2.1/os-volumes/eb0c3903-9a09-485b-b6f9-aced81233629 HTTP/1.1 May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigp5lNAtJXiq9L_BzZFkqQKzt7Q7CkCINWFgtRvQTHi6-E3lz9GbATtXlPw3F6PpnxQqTOLhrifejqXy0NqULF4Y66Fl-Ne-5zkBVXBohYOpsRz-eGpfCMWYVZJGy8ePw4kATIA3S2Clhe39DR-y9MlNDSwxrizx3LDuY_vUsu4_KuJk May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:38.035220 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesNegativeTest-1055067427 May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 31b47f666fb945428ddb9aa0672bc8db May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Volume eb0c3903-9a09-485b-b6f9-aced81233629 could not be found. May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'eb0c3903-9a09-485b-b6f9-aced81233629'} May 16 18:56:38.036707 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb0c3903-9a09-485b-b6f9-aced81233629 could not be found. (HTTP 404) (Request-ID: req-5c98ea9e-95e9-4234-9a94-c792ddaf220b) May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:38.037476 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 18:56:38.038585 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb0c3903-9a09-485b-b6f9-aced81233629 could not be found. May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 18:56:38.039729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb0c3903-9a09-485b-b6f9-aced81233629 could not be found. May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb0c3903-9a09-485b-b6f9-aced81233629 could not be found. May 16 18:56:38.040939 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.042105 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-598a7d78-8187-4cf1-a4f0-dbf6efabc05c tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Returning 404 to user: Volume eb0c3903-9a09-485b-b6f9-aced81233629 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:38.042818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-598a7d78-8187-4cf1-a4f0-dbf6efabc05c tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/eb0c3903-9a09-485b-b6f9-aced81233629" status: 404 len: 109 microversion: 2.1 time: 0.050904 May 16 18:56:38.043604 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 509/995] 10.222.0.72 () {58 vars in 1247 bytes} [Mon May 16 18:56:37 2022] DELETE /compute/v2.1/os-volumes/eb0c3903-9a09-485b-b6f9-aced81233629 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:38.056519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-822d8a8c-a434-46fd-a34c-5c9f2b8c2e6e tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Calling method '.version_select at 0x7f646cf2fd30>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:38.087764 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-822d8a8c-a434-46fd-a34c-5c9f2b8c2e6e tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] HTTP exception thrown: Volume 409d524a-beb5-4afc-97ae-ef339799e91e could not be found. May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-822d8a8c-a434-46fd-a34c-5c9f2b8c2e6e tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Request method failure captured: May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/os-volumes/409d524a-beb5-4afc-97ae-ef339799e91e HTTP/1.1 May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigp5lNAtJXiq9L_BzZFkqQKzt7Q7CkCINWFgtRvQTHi6-E3lz9GbATtXlPw3F6PpnxQqTOLhrifejqXy0NqULF4Y66Fl-Ne-5zkBVXBohYOpsRz-eGpfCMWYVZJGy8ePw4kATIA3S2Clhe39DR-y9MlNDSwxrizx3LDuY_vUsu4_KuJk May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:38.089690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d6af9d4f1491494baf8a01fc111d041b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesNegativeTest-1055067427 May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: d6af9d4f1491494baf8a01fc111d041b May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesNegativeTest-1055067427 May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 31b47f666fb945428ddb9aa0672bc8db May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesNegativeTest-1055067427-project May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Volume 409d524a-beb5-4afc-97ae-ef339799e91e could not be found. May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '409d524a-beb5-4afc-97ae-ef339799e91e'} May 16 18:56:38.093171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 409d524a-beb5-4afc-97ae-ef339799e91e could not be found. (HTTP 404) (Request-ID: req-75b8c48f-b1b4-47b8-9840-1e2e1c469a35) May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:38.095136 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 18:56:38.097491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 409d524a-beb5-4afc-97ae-ef339799e91e could not be found. May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 18:56:38.099531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 409d524a-beb5-4afc-97ae-ef339799e91e could not be found. May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 409d524a-beb5-4afc-97ae-ef339799e91e could not be found. May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-822d8a8c-a434-46fd-a34c-5c9f2b8c2e6e tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] Returning 404 to user: Volume 409d524a-beb5-4afc-97ae-ef339799e91e could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-822d8a8c-a434-46fd-a34c-5c9f2b8c2e6e tempest-VolumesNegativeTest-1055067427 tempest-VolumesNegativeTest-1055067427-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/409d524a-beb5-4afc-97ae-ef339799e91e" status: 404 len: 109 microversion: 2.1 time: 0.039615 May 16 18:56:38.101777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 510/996] 10.222.0.72 () {58 vars in 1244 bytes} [Mon May 16 18:56:38 2022] GET /compute/v2.1/os-volumes/409d524a-beb5-4afc-97ae-ef339799e91e => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:38.134519 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e291bb0f-c210-4eef-b409-704bf19249c0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:38.146460 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e291bb0f-c210-4eef-b409-704bf19249c0 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1451 microversion: 2.1 time: 0.363645 May 16 18:56:38.147598 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 487/997] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:37 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1451 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:56:38.434631 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-7ad31f0c-101e-4e94-8bc9-32a2e0773667 req-7d1f15a8-eabd-4032-9b0f-e736be29308d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12aa2a80-3944-4ff6-9b34-ada2debe18c5", "name": "network-vif-deleted", "tag": "fbd9282a-e554-4f50-b165-7ce5f6ec3daa"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:56:38.450932 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-7ad31f0c-101e-4e94-8bc9-32a2e0773667 req-7d1f15a8-eabd-4032-9b0f-e736be29308d service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:38.451489 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-7ad31f0c-101e-4e94-8bc9-32a2e0773667 req-7d1f15a8-eabd-4032-9b0f-e736be29308d service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:38.464084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-7ad31f0c-101e-4e94-8bc9-32a2e0773667 req-7d1f15a8-eabd-4032-9b0f-e736be29308d service nova] Creating event network-vif-deleted:fbd9282a-e554-4f50-b165-7ce5f6ec3daa for instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 on hv-cinder-75078 May 16 18:56:38.470482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-7ad31f0c-101e-4e94-8bc9-32a2e0773667 req-7d1f15a8-eabd-4032-9b0f-e736be29308d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041262 May 16 18:56:38.480341 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 511/998] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:39.176058 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:39.177241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:39.193557 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:39.194361 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:39.195844 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:39.196627 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:39.274826 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:39.275623 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:39.276409 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lazy-loading 'fault' on Instance uuid 12aa2a80-3944-4ff6-9b34-ada2debe18c5 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:56:39.276524 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1aa618dd-6587-4a41-aeb0-af7d7d73211c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:39.278525 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1aa618dd-6587-4a41-aeb0-af7d7d73211c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:39.291242 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1aa618dd-6587-4a41-aeb0-af7d7d73211c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:39.292342 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1aa618dd-6587-4a41-aeb0-af7d7d73211c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:39.293840 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1aa618dd-6587-4a41-aeb0-af7d7d73211c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:39.295113 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1aa618dd-6587-4a41-aeb0-af7d7d73211c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:39.341652 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258580b81cf0480d9728500884442b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405413536bdb433fbb7d03c8ccd34283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:39.351086 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ceee9d6c-0a18-4392-aefa-7a5b6d331bf3 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 200 len: 1225 microversion: 2.1 time: 0.189280 May 16 18:56:39.352066 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 488/999] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:39 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 1225 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:56:39.366374 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1aa618dd-6587-4a41-aeb0-af7d7d73211c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.092584 May 16 18:56:39.366374 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 512/1000] 10.222.0.72 () {60 vars in 1342 bytes} [Mon May 16 18:56:39 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:56:39.435372 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-49b5f763-c270-4415-b6f9-5a63c452caab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:39.442803 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-49b5f763-c270-4415-b6f9-5a63c452caab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:39.450341 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49b5f763-c270-4415-b6f9-5a63c452caab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:39.450963 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49b5f763-c270-4415-b6f9-5a63c452caab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:39.451598 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49b5f763-c270-4415-b6f9-5a63c452caab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:39.452151 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49b5f763-c270-4415-b6f9-5a63c452caab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:39.480956 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-49b5f763-c270-4415-b6f9-5a63c452caab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:56:39.604380 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-49b5f763-c270-4415-b6f9-5a63c452caab tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "DELETE /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 204 len: 0 microversion: 2.20 time: 0.172713 May 16 18:56:39.607761 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 489/1001] 10.222.0.72 () {60 vars in 1279 bytes} [Mon May 16 18:56:39 2022] DELETE /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 18:56:39.619159 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-82712568-c6da-441f-befa-9fb405424973 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:39.620459 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-82712568-c6da-441f-befa-9fb405424973 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:39.630531 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-82712568-c6da-441f-befa-9fb405424973 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:39.631140 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-82712568-c6da-441f-befa-9fb405424973 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:39.632571 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-82712568-c6da-441f-befa-9fb405424973 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:39.633283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-82712568-c6da-441f-befa-9fb405424973 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:39.854578 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-82712568-c6da-441f-befa-9fb405424973 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:39.868822 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-82712568-c6da-441f-befa-9fb405424973 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:39.870790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-82712568-c6da-441f-befa-9fb405424973 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:39.872705 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-82712568-c6da-441f-befa-9fb405424973 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.261056 May 16 18:56:39.879927 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 513/1002] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:56:39 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 18:56:40.375201 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7dd35881-4131-4732-85f8-a07082368c37 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:40.376420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-7dd35881-4131-4732-85f8-a07082368c37 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] [instance: 12aa2a80-3944-4ff6-9b34-ada2debe18c5] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:40.385388 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7dd35881-4131-4732-85f8-a07082368c37 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:40.386181 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7dd35881-4131-4732-85f8-a07082368c37 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:40.387439 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7dd35881-4131-4732-85f8-a07082368c37 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:40.388231 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-7dd35881-4131-4732-85f8-a07082368c37 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:40.405990 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-7dd35881-4131-4732-85f8-a07082368c37 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] HTTP exception thrown: Instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 could not be found. May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7dd35881-4131-4732-85f8-a07082368c37 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Request method failure captured: May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 HTTP/1.1 May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpz1bRssvPIpBtX9vcgydtBg7Z937cF2Uz74jVZlaozGsq-zQ9J_0Cpz1RqXaAvgr_57NYAZge3fo5uYue0a4i1-U5HWXncCYo54Gnm6m0I4u7R239yDP0nzLt9Os_ZjA6RAzCk_BoIeEuolIFOFN5PXQkqMJBVYSairs5OcpINrrGg May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 405413536bdb433fbb7d03c8ccd34283 May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-TestShelveInstance-1608524440 May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:40.408736 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_405413536bdb433fbb7d03c8ccd34283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/405413536bdb433fbb7d03c8ccd34283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/405413536bdb433fbb7d03c8ccd34283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/405413536bdb433fbb7d03c8ccd34283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-TestShelveInstance-1608524440 May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 405413536bdb433fbb7d03c8ccd34283 May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-TestShelveInstance-1608524440 May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-TestShelveInstance-1608524440-project May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 258580b81cf0480d9728500884442b55 May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-TestShelveInstance-1608524440-project May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 could not be found. May 16 18:56:40.410360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '12aa2a80-3944-4ff6-9b34-ada2debe18c5'} May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 could not be found. May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:40.411111 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 could not be found. May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 could not be found. May 16 18:56:40.412329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:40.413512 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-7dd35881-4131-4732-85f8-a07082368c37 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Returning 404 to user: Instance 12aa2a80-3944-4ff6-9b34-ada2debe18c5 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:40.413512 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-7dd35881-4131-4732-85f8-a07082368c37 tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5" status: 404 len: 111 microversion: 2.1 time: 0.040490 May 16 18:56:40.413512 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 490/1003] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:56:40 2022] GET /compute/v2.1/servers/12aa2a80-3944-4ff6-9b34-ada2debe18c5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:56:40.656719 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2eae7c5d-13e3-4758-bf83-1be9eec3dd0f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] Calling method '.version_select at 0x7f646cf84f70>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:40.695604 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2eae7c5d-13e3-4758-bf83-1be9eec3dd0f tempest-TestShelveInstance-1608524440 tempest-TestShelveInstance-1608524440-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1844395528" status: 202 len: 0 microversion: 2.1 time: 0.044242 May 16 18:56:40.701807 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 514/1004] 10.222.0.72 () {58 vars in 1253 bytes} [Mon May 16 18:56:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1844395528 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:56:40.898704 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-6f09ed97-f324-4a3a-890f-aba6fd71fbd0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:40.899994 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-6f09ed97-f324-4a3a-890f-aba6fd71fbd0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:40.909016 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6f09ed97-f324-4a3a-890f-aba6fd71fbd0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:40.910898 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6f09ed97-f324-4a3a-890f-aba6fd71fbd0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:40.912138 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6f09ed97-f324-4a3a-890f-aba6fd71fbd0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:40.912822 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-6f09ed97-f324-4a3a-890f-aba6fd71fbd0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:41.102951 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6f09ed97-f324-4a3a-890f-aba6fd71fbd0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:41.116895 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6f09ed97-f324-4a3a-890f-aba6fd71fbd0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:41.119013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-6f09ed97-f324-4a3a-890f-aba6fd71fbd0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:41.120812 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-6f09ed97-f324-4a3a-890f-aba6fd71fbd0 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.227507 May 16 18:56:41.122990 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 491/1005] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:56:40 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:56:42.146985 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d0591871-692b-4d8a-9921-df728b1cd936 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:42.147827 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d0591871-692b-4d8a-9921-df728b1cd936 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:42.165348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d0591871-692b-4d8a-9921-df728b1cd936 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:42.166010 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d0591871-692b-4d8a-9921-df728b1cd936 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:42.169164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d0591871-692b-4d8a-9921-df728b1cd936 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:42.169613 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d0591871-692b-4d8a-9921-df728b1cd936 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:42.896940 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d0591871-692b-4d8a-9921-df728b1cd936 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:42.908544 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d0591871-692b-4d8a-9921-df728b1cd936 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:42.914739 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d0591871-692b-4d8a-9921-df728b1cd936 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:42.916031 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d0591871-692b-4d8a-9921-df728b1cd936 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1721 microversion: 2.20 time: 0.774558 May 16 18:56:42.916615 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 515/1006] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:56:42 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1721 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:56:43.516947 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-fa0c7c98-a62c-4b3d-9e9c-20e5ca0a6f78 req-ec26e85f-e17c-4d0f-b00c-3cad09ffa4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b2dd21-9b22-4230-8bee-d6f04f06019f", "name": "network-vif-deleted", "tag": "7c023405-87f2-4ed0-9c4c-c419d714714d"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:56:43.538913 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-fa0c7c98-a62c-4b3d-9e9c-20e5ca0a6f78 req-ec26e85f-e17c-4d0f-b00c-3cad09ffa4ab service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:43.539795 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-fa0c7c98-a62c-4b3d-9e9c-20e5ca0a6f78 req-ec26e85f-e17c-4d0f-b00c-3cad09ffa4ab service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:43.577989 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-fa0c7c98-a62c-4b3d-9e9c-20e5ca0a6f78 req-ec26e85f-e17c-4d0f-b00c-3cad09ffa4ab service nova] Creating event network-vif-deleted:7c023405-87f2-4ed0-9c4c-c419d714714d for instance 86b2dd21-9b22-4230-8bee-d6f04f06019f on hv-cinder-75078 May 16 18:56:43.591812 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-fa0c7c98-a62c-4b3d-9e9c-20e5ca0a6f78 req-ec26e85f-e17c-4d0f-b00c-3cad09ffa4ab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078147 May 16 18:56:43.595133 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 492/1007] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:56:43.935091 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:43.937043 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:43.948718 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:43.950815 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:43.952226 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:43.954159 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:44.075953 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:44.076966 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:44.080413 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lazy-loading 'fault' on Instance uuid 86b2dd21-9b22-4230-8bee-d6f04f06019f {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:56:44.195857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:44.217706 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:44.238478 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8928566ff693460f8243c43078a6a575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cdad09821341cfa56bbc4642d2cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:56:44.244078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8c1b6c9d-ca9f-41e0-b8fd-9bf3a2427de8 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 200 len: 1370 microversion: 2.20 time: 0.313248 May 16 18:56:44.253779 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 516/1008] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:56:43 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 1370 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 18:56:45.272197 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-35e01cd7-46bc-4db5-9d3c-adaa5b2972cf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:45.273181 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-35e01cd7-46bc-4db5-9d3c-adaa5b2972cf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:45.290119 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35e01cd7-46bc-4db5-9d3c-adaa5b2972cf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:45.290572 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35e01cd7-46bc-4db5-9d3c-adaa5b2972cf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:45.291355 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35e01cd7-46bc-4db5-9d3c-adaa5b2972cf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:45.291816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35e01cd7-46bc-4db5-9d3c-adaa5b2972cf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:45.345928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-35e01cd7-46bc-4db5-9d3c-adaa5b2972cf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] HTTP exception thrown: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-35e01cd7-46bc-4db5-9d3c-adaa5b2972cf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Request method failure captured: May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f HTTP/1.1 May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyPqvNoFylpxYK_UtLaeSas4VI2xl7Mn_ENvadFlg3rgclJdSPgwQtmhu03gctot0XRJFM95yzoj_fkMYwz1g2pVIo-HzvEWJ2meCZHh1wBOSSn9JpCEq5vwsWJUhH3QOW3udvYirDFpwyEXKusamc11ZkAXUpwnMBMhr3Sq4NUXCo May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Openstack-Nova-Api-Version: 2.20 May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:45.350269 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 8928566ff693460f8243c43078a6a575 May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:45.351661 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '86b2dd21-9b22-4230-8bee-d6f04f06019f'} May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:45.352880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:45.354108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:45.355228 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-35e01cd7-46bc-4db5-9d3c-adaa5b2972cf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Returning 404 to user: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:45.355379 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-35e01cd7-46bc-4db5-9d3c-adaa5b2972cf tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 404 len: 111 microversion: 2.20 time: 0.092612 May 16 18:56:45.357020 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 493/1009] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:56:45 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 18:56:45.368030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-395f5a68-1ef6-4ede-a0db-97f21200af83 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '.version_select at 0x7f646821daf0>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:45.398828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-395f5a68-1ef6-4ede-a0db-97f21200af83 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-194357325" status: 204 len: 0 microversion: 2.20 time: 0.036737 May 16 18:56:45.399470 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 517/1010] 10.222.0.72 () {60 vars in 1258 bytes} [Mon May 16 18:56:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-194357325 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 18:56:47.928588 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9d558b5a-0cc4-4d3e-be5f-a295c602030c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:47.929110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9d558b5a-0cc4-4d3e-be5f-a295c602030c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:47.938780 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9d558b5a-0cc4-4d3e-be5f-a295c602030c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:47.939343 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9d558b5a-0cc4-4d3e-be5f-a295c602030c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:47.940292 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9d558b5a-0cc4-4d3e-be5f-a295c602030c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:47.941387 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9d558b5a-0cc4-4d3e-be5f-a295c602030c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:47.956918 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-9d558b5a-0cc4-4d3e-be5f-a295c602030c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] HTTP exception thrown: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9d558b5a-0cc4-4d3e-be5f-a295c602030c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Request method failure captured: May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: DELETE /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f HTTP/1.1 May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyPqvNoFylpxYK_UtLaeSas4VI2xl7Mn_ENvadFlg3rgclJdSPgwQtmhu03gctot0XRJFM95yzoj_fkMYwz1g2pVIo-HzvEWJ2meCZHh1wBOSSn9JpCEq5vwsWJUhH3QOW3udvYirDFpwyEXKusamc11ZkAXUpwnMBMhr3Sq4NUXCo May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Openstack-Nova-Api-Version: 2.20 May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:47.958816 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 8928566ff693460f8243c43078a6a575 May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:47.960279 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '86b2dd21-9b22-4230-8bee-d6f04f06019f'} May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:47.961094 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:47.962275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:47.963477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9d558b5a-0cc4-4d3e-be5f-a295c602030c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Returning 404 to user: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:47.963477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9d558b5a-0cc4-4d3e-be5f-a295c602030c tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "DELETE /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 404 len: 111 microversion: 2.20 time: 0.036832 May 16 18:56:47.963477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 494/1011] 10.222.0.72 () {60 vars in 1279 bytes} [Mon May 16 18:56:47 2022] DELETE /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 18:56:47.970270 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4ec44ec0-8b19-4c9c-a97f-20b4e242a96a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:47.970891 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-4ec44ec0-8b19-4c9c-a97f-20b4e242a96a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 86b2dd21-9b22-4230-8bee-d6f04f06019f] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:47.978761 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ec44ec0-8b19-4c9c-a97f-20b4e242a96a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:47.979223 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ec44ec0-8b19-4c9c-a97f-20b4e242a96a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:47.980058 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ec44ec0-8b19-4c9c-a97f-20b4e242a96a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:47.980645 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4ec44ec0-8b19-4c9c-a97f-20b4e242a96a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:47.995088 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-4ec44ec0-8b19-4c9c-a97f-20b4e242a96a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] HTTP exception thrown: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4ec44ec0-8b19-4c9c-a97f-20b4e242a96a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Request method failure captured: May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f HTTP/1.1 May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyPqvNoFylpxYK_UtLaeSas4VI2xl7Mn_ENvadFlg3rgclJdSPgwQtmhu03gctot0XRJFM95yzoj_fkMYwz1g2pVIo-HzvEWJ2meCZHh1wBOSSn9JpCEq5vwsWJUhH3QOW3udvYirDFpwyEXKusamc11ZkAXUpwnMBMhr3Sq4NUXCo May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Openstack-Nova-Api-Version: 2.20 May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:47.996802 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 8928566ff693460f8243c43078a6a575 May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:47.998166 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '86b2dd21-9b22-4230-8bee-d6f04f06019f'} May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:47.998886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. May 16 18:56:48.000100 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:48.001589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4ec44ec0-8b19-4c9c-a97f-20b4e242a96a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Returning 404 to user: Instance 86b2dd21-9b22-4230-8bee-d6f04f06019f could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:48.001589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-4ec44ec0-8b19-4c9c-a97f-20b4e242a96a tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f" status: 404 len: 111 microversion: 2.20 time: 0.032988 May 16 18:56:48.001589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 518/1012] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:56:47 2022] GET /compute/v2.1/servers/86b2dd21-9b22-4230-8bee-d6f04f06019f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 18:56:49.177852 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e3e1b90a-6a6b-49ab-b161-c4cd8fd0c1b3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:49.179005 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e3e1b90a-6a6b-49ab-b161-c4cd8fd0c1b3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:49.195624 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e3e1b90a-6a6b-49ab-b161-c4cd8fd0c1b3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:49.196458 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e3e1b90a-6a6b-49ab-b161-c4cd8fd0c1b3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:49.199350 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e3e1b90a-6a6b-49ab-b161-c4cd8fd0c1b3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:49.200070 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e3e1b90a-6a6b-49ab-b161-c4cd8fd0c1b3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:49.242429 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-e3e1b90a-6a6b-49ab-b161-c4cd8fd0c1b3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] HTTP exception thrown: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e3e1b90a-6a6b-49ab-b161-c4cd8fd0c1b3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Request method failure captured: May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: DELETE /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 HTTP/1.1 May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigpyPqvNoFylpxYK_UtLaeSas4VI2xl7Mn_ENvadFlg3rgclJdSPgwQtmhu03gctot0XRJFM95yzoj_fkMYwz1g2pVIo-HzvEWJ2meCZHh1wBOSSn9JpCEq5vwsWJUhH3QOW3udvYirDFpwyEXKusamc11ZkAXUpwnMBMhr3Sq4NUXCo May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Openstack-Nova-Api-Version: 2.20 May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:56:49.244481 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 8928566ff693460f8243c43078a6a575 May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:56:49.246140 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '4de1432f-5419-4150-84a0-0fe456962ce9'} May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:49.247013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:56:49.248477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:56:49.252842 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e3e1b90a-6a6b-49ab-b161-c4cd8fd0c1b3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Returning 404 to user: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:49.253791 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e3e1b90a-6a6b-49ab-b161-c4cd8fd0c1b3 tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 404 len: 111 microversion: 2.20 time: 0.081279 May 16 18:56:49.256483 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 495/1013] 10.222.0.72 () {60 vars in 1279 bytes} [Mon May 16 18:56:49 2022] DELETE /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 18:56:49.263243 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-46a034ac-ac42-4f8f-bf20-d1b308ae2d2b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:56:49.263948 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-46a034ac-ac42-4f8f-bf20-d1b308ae2d2b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] [instance: 4de1432f-5419-4150-84a0-0fe456962ce9] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:56:49.280615 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46a034ac-ac42-4f8f-bf20-d1b308ae2d2b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:49.281084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46a034ac-ac42-4f8f-bf20-d1b308ae2d2b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:49.281894 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46a034ac-ac42-4f8f-bf20-d1b308ae2d2b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:56:49.282340 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-46a034ac-ac42-4f8f-bf20-d1b308ae2d2b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:56:49.323683 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-46a034ac-ac42-4f8f-bf20-d1b308ae2d2b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] HTTP exception thrown: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-46a034ac-ac42-4f8f-bf20-d1b308ae2d2b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Request method failure captured: May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 HTTP/1.1 May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigpyPqvNoFylpxYK_UtLaeSas4VI2xl7Mn_ENvadFlg3rgclJdSPgwQtmhu03gctot0XRJFM95yzoj_fkMYwz1g2pVIo-HzvEWJ2meCZHh1wBOSSn9JpCEq5vwsWJUhH3QOW3udvYirDFpwyEXKusamc11ZkAXUpwnMBMhr3Sq4NUXCo May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Openstack-Nova-Api-Version: 2.20 May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:56:49.326751 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67cdad09821341cfa56bbc4642d2cd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 67cdad09821341cfa56bbc4642d2cd04 May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1139364073 May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 8928566ff693460f8243c43078a6a575 May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1139364073-project May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:56:49.328453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '4de1432f-5419-4150-84a0-0fe456962ce9'} May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:56:49.329447 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. May 16 18:56:49.330901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:56:49.334046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-46a034ac-ac42-4f8f-bf20-d1b308ae2d2b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] Returning 404 to user: Instance 4de1432f-5419-4150-84a0-0fe456962ce9 could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:56:49.334046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-46a034ac-ac42-4f8f-bf20-d1b308ae2d2b tempest-AttachVolumeShelveTestJSON-1139364073 tempest-AttachVolumeShelveTestJSON-1139364073-project] 10.222.0.72 "GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9" status: 404 len: 111 microversion: 2.20 time: 0.071594 May 16 18:56:49.334046 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 519/1014] 10.222.0.72 () {60 vars in 1276 bytes} [Mon May 16 18:56:49 2022] GET /compute/v2.1/servers/4de1432f-5419-4150-84a0-0fe456962ce9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 18:57:19.503284 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 18:57:19.503917 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Mon May 16 18:57:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 18:57:21.398446 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-515036891", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "networks": [{"uuid": "b95187d3-253b-461a-b026-7d62a560dcd2"}]}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:57:21.450802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] validate_networks() for [('b95187d3-253b-461a-b026-7d62a560dcd2', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:57:21.817194 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:57:21.817786 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:57:21.818258 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:57:21.818802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:57:21.819213 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:57:21.828521 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:21.828967 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:21.829769 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:21.830211 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:21.847343 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Getting quotas for project 9cf09aab60304f30ae52a87b7b1ea81a. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:57:21.851340 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Getting quotas for user 9cb61d5251e74d529a6bfa7d3a684123 and project 9cf09aab60304f30ae52a87b7b1ea81a. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:57:21.862955 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:57:21.865275 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:57:21.917857 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-52ffc28c-0347-4138-801e-154a7d9fa583 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523408 May 16 18:57:21.918596 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 496/1015] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:57:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:57:21.929053 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-67ae8835-cc86-4a53-b20e-84521c55850b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:21.930890 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-67ae8835-cc86-4a53-b20e-84521c55850b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:21.984825 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-67ae8835-cc86-4a53-b20e-84521c55850b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:21.992306 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-67ae8835-cc86-4a53-b20e-84521c55850b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1218 microversion: 2.1 time: 0.066824 May 16 18:57:21.992995 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 520/1016] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:21 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:23.010880 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5f671cf7-b6b3-4f9b-905e-bdb4e53a4451 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:23.011575 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5f671cf7-b6b3-4f9b-905e-bdb4e53a4451 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:23.020073 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f671cf7-b6b3-4f9b-905e-bdb4e53a4451 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:23.021618 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f671cf7-b6b3-4f9b-905e-bdb4e53a4451 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:23.023114 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f671cf7-b6b3-4f9b-905e-bdb4e53a4451 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:23.024410 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5f671cf7-b6b3-4f9b-905e-bdb4e53a4451 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:23.102385 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5f671cf7-b6b3-4f9b-905e-bdb4e53a4451 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:23.112873 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5f671cf7-b6b3-4f9b-905e-bdb4e53a4451 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1276 microversion: 2.1 time: 0.104869 May 16 18:57:23.113580 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 497/1017] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:23 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:24.131283 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-2c13878e-def6-49ad-baae-e752f55e6db8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:24.131950 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-2c13878e-def6-49ad-baae-e752f55e6db8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:24.140120 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2c13878e-def6-49ad-baae-e752f55e6db8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:24.140578 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2c13878e-def6-49ad-baae-e752f55e6db8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:24.141368 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2c13878e-def6-49ad-baae-e752f55e6db8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:24.141810 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-2c13878e-def6-49ad-baae-e752f55e6db8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:24.346583 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-2c13878e-def6-49ad-baae-e752f55e6db8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:24.354388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-2c13878e-def6-49ad-baae-e752f55e6db8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1318 microversion: 2.1 time: 0.227815 May 16 18:57:24.355128 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 521/1018] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:24 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:24.651174 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-0d96e579-956f-4ac5-b55c-8b388a5f9f3d req-d4ccd1ae-9134-425b-935f-b22719a434c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5303dd81-d9ae-49a9-8d35-f7584e91aecc", "tag": "451d3565-ef78-43e5-aa1f-1741fb7624c4"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:57:24.662622 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-0d96e579-956f-4ac5-b55c-8b388a5f9f3d req-d4ccd1ae-9134-425b-935f-b22719a434c3 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:24.663386 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-0d96e579-956f-4ac5-b55c-8b388a5f9f3d req-d4ccd1ae-9134-425b-935f-b22719a434c3 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:24.676396 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-0d96e579-956f-4ac5-b55c-8b388a5f9f3d req-d4ccd1ae-9134-425b-935f-b22719a434c3 service nova] Creating event network-changed:451d3565-ef78-43e5-aa1f-1741fb7624c4 for instance 5303dd81-d9ae-49a9-8d35-f7584e91aecc on hv-cinder-75078 May 16 18:57:24.686313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-0d96e579-956f-4ac5-b55c-8b388a5f9f3d req-d4ccd1ae-9134-425b-935f-b22719a434c3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038437 May 16 18:57:24.687688 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 498/1019] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:57:25.374632 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a4631962-fc59-4c78-b879-9f41767b967d tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:25.375571 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a4631962-fc59-4c78-b879-9f41767b967d tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:25.382338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a4631962-fc59-4c78-b879-9f41767b967d tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:25.382589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a4631962-fc59-4c78-b879-9f41767b967d tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:25.383193 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a4631962-fc59-4c78-b879-9f41767b967d tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:25.383630 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a4631962-fc59-4c78-b879-9f41767b967d tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:25.589554 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a4631962-fc59-4c78-b879-9f41767b967d tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:25.598832 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a4631962-fc59-4c78-b879-9f41767b967d tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1318 microversion: 2.1 time: 0.228076 May 16 18:57:25.599316 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 522/1020] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:25 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:26.621356 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4046c667-cccd-4a61-a5e5-84bfb961fb90 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:26.622818 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4046c667-cccd-4a61-a5e5-84bfb961fb90 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:26.630092 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4046c667-cccd-4a61-a5e5-84bfb961fb90 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:26.630630 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4046c667-cccd-4a61-a5e5-84bfb961fb90 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:26.631490 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4046c667-cccd-4a61-a5e5-84bfb961fb90 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:26.632027 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4046c667-cccd-4a61-a5e5-84bfb961fb90 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:26.770823 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4046c667-cccd-4a61-a5e5-84bfb961fb90 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:26.779780 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4046c667-cccd-4a61-a5e5-84bfb961fb90 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1318 microversion: 2.1 time: 0.165540 May 16 18:57:26.780382 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 499/1021] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:26 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:27.797648 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7c79c0ca-82db-4e76-9366-b68d368ad356 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:27.798262 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7c79c0ca-82db-4e76-9366-b68d368ad356 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:27.805186 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c79c0ca-82db-4e76-9366-b68d368ad356 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:27.805640 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c79c0ca-82db-4e76-9366-b68d368ad356 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:27.806675 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c79c0ca-82db-4e76-9366-b68d368ad356 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:27.807115 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c79c0ca-82db-4e76-9366-b68d368ad356 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:27.962512 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7c79c0ca-82db-4e76-9366-b68d368ad356 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:27.972309 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7c79c0ca-82db-4e76-9366-b68d368ad356 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1318 microversion: 2.1 time: 0.177459 May 16 18:57:27.973213 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 523/1022] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:27 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:28.990006 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-56ad9915-1d2c-42e5-a930-1b38ff320ee0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:28.990629 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-56ad9915-1d2c-42e5-a930-1b38ff320ee0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:28.997811 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-56ad9915-1d2c-42e5-a930-1b38ff320ee0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:28.998271 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-56ad9915-1d2c-42e5-a930-1b38ff320ee0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:28.999245 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-56ad9915-1d2c-42e5-a930-1b38ff320ee0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:28.999885 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-56ad9915-1d2c-42e5-a930-1b38ff320ee0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:29.176715 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-56ad9915-1d2c-42e5-a930-1b38ff320ee0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:29.184603 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-56ad9915-1d2c-42e5-a930-1b38ff320ee0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1318 microversion: 2.1 time: 0.198741 May 16 18:57:29.185016 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 500/1023] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:28 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:30.203231 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5835d496-740c-4b8a-a735-3d12213282e8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:30.203920 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5835d496-740c-4b8a-a735-3d12213282e8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:30.212346 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5835d496-740c-4b8a-a735-3d12213282e8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:30.212793 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5835d496-740c-4b8a-a735-3d12213282e8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:30.213572 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5835d496-740c-4b8a-a735-3d12213282e8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:30.214018 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5835d496-740c-4b8a-a735-3d12213282e8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:30.384069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5835d496-740c-4b8a-a735-3d12213282e8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:30.392971 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5835d496-740c-4b8a-a735-3d12213282e8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1318 microversion: 2.1 time: 0.192109 May 16 18:57:30.394037 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 524/1024] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:30 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:31.410181 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-406f47ea-cca6-463d-ba0d-d472dd1a7b81 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:31.411203 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-406f47ea-cca6-463d-ba0d-d472dd1a7b81 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:31.417294 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-406f47ea-cca6-463d-ba0d-d472dd1a7b81 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:31.417778 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-406f47ea-cca6-463d-ba0d-d472dd1a7b81 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:31.418548 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-406f47ea-cca6-463d-ba0d-d472dd1a7b81 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:31.418983 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-406f47ea-cca6-463d-ba0d-d472dd1a7b81 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:31.594492 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-406f47ea-cca6-463d-ba0d-d472dd1a7b81 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:31.603671 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-406f47ea-cca6-463d-ba0d-d472dd1a7b81 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1318 microversion: 2.1 time: 0.197469 May 16 18:57:31.604557 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 501/1025] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:31 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:32.504282 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-0f75c503-2456-4ed4-8f5e-40c3fe34eb94 req-bafd0ed9-18df-4dc0-8dce-ae6b5cc52cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5303dd81-d9ae-49a9-8d35-f7584e91aecc", "name": "network-vif-plugged", "status": "completed", "tag": "451d3565-ef78-43e5-aa1f-1741fb7624c4"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:57:32.513911 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-0f75c503-2456-4ed4-8f5e-40c3fe34eb94 req-bafd0ed9-18df-4dc0-8dce-ae6b5cc52cb3 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:32.514799 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-0f75c503-2456-4ed4-8f5e-40c3fe34eb94 req-bafd0ed9-18df-4dc0-8dce-ae6b5cc52cb3 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:32.528506 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-0f75c503-2456-4ed4-8f5e-40c3fe34eb94 req-bafd0ed9-18df-4dc0-8dce-ae6b5cc52cb3 service nova] Creating event network-vif-plugged:451d3565-ef78-43e5-aa1f-1741fb7624c4 for instance 5303dd81-d9ae-49a9-8d35-f7584e91aecc on hv-cinder-75078 May 16 18:57:32.534899 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-0f75c503-2456-4ed4-8f5e-40c3fe34eb94 req-bafd0ed9-18df-4dc0-8dce-ae6b5cc52cb3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036364 May 16 18:57:32.535974 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 525/1026] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:57:32.621241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-841b0041-a4d3-41fa-827c-9bcc5d2fb2f2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:32.622015 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-841b0041-a4d3-41fa-827c-9bcc5d2fb2f2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:32.632694 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-841b0041-a4d3-41fa-827c-9bcc5d2fb2f2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:32.633472 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-841b0041-a4d3-41fa-827c-9bcc5d2fb2f2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:32.634614 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-841b0041-a4d3-41fa-827c-9bcc5d2fb2f2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:32.635307 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-841b0041-a4d3-41fa-827c-9bcc5d2fb2f2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:33.038696 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-841b0041-a4d3-41fa-827c-9bcc5d2fb2f2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:33.052234 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-841b0041-a4d3-41fa-827c-9bcc5d2fb2f2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1318 microversion: 2.1 time: 0.434999 May 16 18:57:33.067456 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 502/1027] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:32 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:34.075538 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9e63de2a-7224-4dae-8260-525ef27847e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:34.076360 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9e63de2a-7224-4dae-8260-525ef27847e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:34.083117 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9e63de2a-7224-4dae-8260-525ef27847e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:34.083576 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9e63de2a-7224-4dae-8260-525ef27847e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:34.084936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9e63de2a-7224-4dae-8260-525ef27847e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:34.084936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9e63de2a-7224-4dae-8260-525ef27847e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:34.279732 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9e63de2a-7224-4dae-8260-525ef27847e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:34.293725 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9e63de2a-7224-4dae-8260-525ef27847e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1318 microversion: 2.1 time: 0.222747 May 16 18:57:34.295811 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 526/1028] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:34 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:35.170531 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2069675756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-426666422", "security_groups": [{"name": "tempest-secgroup-smoke-1652304659"}], "block_device_mapping_v2": [{"uuid": "87e830a7-dfd3-46bc-9044-27d7f897c04f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bdc43d0-da09-483c-a5e7-ef200c0654fb"}]}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:57:35.304734 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] validate_networks() for [('3bdc43d0-da09-483c-a5e7-ef200c0654fb', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:57:35.315446 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-440f16f9-9a50-4670-ac8d-4374c635e1ae tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:35.317528 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-440f16f9-9a50-4670-ac8d-4374c635e1ae tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:35.325744 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-440f16f9-9a50-4670-ac8d-4374c635e1ae tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:35.326265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-440f16f9-9a50-4670-ac8d-4374c635e1ae tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:35.327052 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-440f16f9-9a50-4670-ac8d-4374c635e1ae tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:35.327659 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-440f16f9-9a50-4670-ac8d-4374c635e1ae tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:35.585195 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-440f16f9-9a50-4670-ac8d-4374c635e1ae tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:35.594103 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-440f16f9-9a50-4670-ac8d-4374c635e1ae tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1508 microversion: 2.1 time: 0.285223 May 16 18:57:35.594685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 527/1029] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:35 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:35.816561 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:57:35.816985 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:57:35.817462 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:57:35.817994 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:57:35.818299 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:57:35.827511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:35.828044 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:35.829134 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:35.829288 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:35.846955 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Getting quotas for project 5b168bfd42a645269b47c98f4210e4aa. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:57:35.851776 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Getting quotas for user 5e9ebfaac4984817bb768476ef74445c and project 5b168bfd42a645269b47c98f4210e4aa. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:57:35.943389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:57:35.946920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87e830a7-dfd3-46bc-9044-27d7f897c04f',volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:57:36.131477 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2ce81e8b-ff96-44b3-acf3-663557df436b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.964638 May 16 18:57:36.132119 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 503/1030] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:57:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:57:36.142554 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-01a5974d-e257-4622-b54a-bed7d8819a8b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:36.143175 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-01a5974d-e257-4622-b54a-bed7d8819a8b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:36.202907 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-01a5974d-e257-4622-b54a-bed7d8819a8b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:36.209822 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-01a5974d-e257-4622-b54a-bed7d8819a8b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1094 microversion: 2.1 time: 0.071292 May 16 18:57:36.210400 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 528/1031] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:36 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:37.228563 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-85e75e5e-a4e1-4dda-aaf3-260444ec1747 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:37.229280 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-85e75e5e-a4e1-4dda-aaf3-260444ec1747 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:37.238371 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-85e75e5e-a4e1-4dda-aaf3-260444ec1747 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:37.238837 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-85e75e5e-a4e1-4dda-aaf3-260444ec1747 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:37.239633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-85e75e5e-a4e1-4dda-aaf3-260444ec1747 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:37.240189 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-85e75e5e-a4e1-4dda-aaf3-260444ec1747 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:37.326137 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-85e75e5e-a4e1-4dda-aaf3-260444ec1747 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:37.338626 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-85e75e5e-a4e1-4dda-aaf3-260444ec1747 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1192 microversion: 2.1 time: 0.114249 May 16 18:57:37.339697 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 504/1032] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:37 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1192 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:38.366834 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a6ef0910-aff9-4d7a-bd91-2ad0d8e22869 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:38.369412 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a6ef0910-aff9-4d7a-bd91-2ad0d8e22869 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:38.376854 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6ef0910-aff9-4d7a-bd91-2ad0d8e22869 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:38.377924 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6ef0910-aff9-4d7a-bd91-2ad0d8e22869 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:38.378896 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6ef0910-aff9-4d7a-bd91-2ad0d8e22869 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:38.379515 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6ef0910-aff9-4d7a-bd91-2ad0d8e22869 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:38.638998 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a6ef0910-aff9-4d7a-bd91-2ad0d8e22869 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:38.648710 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a6ef0910-aff9-4d7a-bd91-2ad0d8e22869 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.288415 May 16 18:57:38.649493 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 529/1033] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:38 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:39.247110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-b3105a28-4da7-43c2-8492-bf406f12c105 req-b97a644b-8f50-4afa-9225-4715bb2f9205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97a9c223-ae61-46b2-b25b-e996c79938c2", "tag": "f3724a00-7e9f-4041-8edf-d95832fa4fc7"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:57:39.265829 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-b3105a28-4da7-43c2-8492-bf406f12c105 req-b97a644b-8f50-4afa-9225-4715bb2f9205 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:39.266592 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-b3105a28-4da7-43c2-8492-bf406f12c105 req-b97a644b-8f50-4afa-9225-4715bb2f9205 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:39.302453 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-b3105a28-4da7-43c2-8492-bf406f12c105 req-b97a644b-8f50-4afa-9225-4715bb2f9205 service nova] Creating event network-changed:f3724a00-7e9f-4041-8edf-d95832fa4fc7 for instance 97a9c223-ae61-46b2-b25b-e996c79938c2 on hv-cinder-75078 May 16 18:57:39.313141 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-b3105a28-4da7-43c2-8492-bf406f12c105 req-b97a644b-8f50-4afa-9225-4715bb2f9205 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072751 May 16 18:57:39.315402 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 505/1034] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:57:39.667812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-44d6fc58-99a7-4a6b-bc02-c1aaeb75c7ad tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:39.668539 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-44d6fc58-99a7-4a6b-bc02-c1aaeb75c7ad tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:39.676150 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-44d6fc58-99a7-4a6b-bc02-c1aaeb75c7ad tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:39.676602 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-44d6fc58-99a7-4a6b-bc02-c1aaeb75c7ad tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:39.677395 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-44d6fc58-99a7-4a6b-bc02-c1aaeb75c7ad tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:39.677842 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-44d6fc58-99a7-4a6b-bc02-c1aaeb75c7ad tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:39.836367 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-44d6fc58-99a7-4a6b-bc02-c1aaeb75c7ad tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:39.852822 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-44d6fc58-99a7-4a6b-bc02-c1aaeb75c7ad tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.189357 May 16 18:57:39.864001 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 530/1035] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:39 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:40.872876 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-67a72d97-1ea3-4908-84e2-050e7dd23ad8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:40.873587 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-67a72d97-1ea3-4908-84e2-050e7dd23ad8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:40.881204 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-67a72d97-1ea3-4908-84e2-050e7dd23ad8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:40.881655 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-67a72d97-1ea3-4908-84e2-050e7dd23ad8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:40.882452 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-67a72d97-1ea3-4908-84e2-050e7dd23ad8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:40.882900 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-67a72d97-1ea3-4908-84e2-050e7dd23ad8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:41.071894 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-67a72d97-1ea3-4908-84e2-050e7dd23ad8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:41.080645 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-67a72d97-1ea3-4908-84e2-050e7dd23ad8 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.212445 May 16 18:57:41.081223 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 506/1036] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:40 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:42.100173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-649cc8c4-9550-47c5-b068-e9aa26b0c300 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:42.100914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-649cc8c4-9550-47c5-b068-e9aa26b0c300 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:42.107907 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-649cc8c4-9550-47c5-b068-e9aa26b0c300 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:42.108434 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-649cc8c4-9550-47c5-b068-e9aa26b0c300 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:42.109267 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-649cc8c4-9550-47c5-b068-e9aa26b0c300 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:42.109741 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-649cc8c4-9550-47c5-b068-e9aa26b0c300 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:42.331985 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-649cc8c4-9550-47c5-b068-e9aa26b0c300 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:42.347187 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-649cc8c4-9550-47c5-b068-e9aa26b0c300 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.251941 May 16 18:57:42.358078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 531/1037] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:42 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:43.368665 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-534db0c1-484f-44ba-9d72-6e487e44ec2b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:43.369656 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-534db0c1-484f-44ba-9d72-6e487e44ec2b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:43.379578 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-534db0c1-484f-44ba-9d72-6e487e44ec2b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:43.380987 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-534db0c1-484f-44ba-9d72-6e487e44ec2b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:43.381966 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-534db0c1-484f-44ba-9d72-6e487e44ec2b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:43.382650 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-534db0c1-484f-44ba-9d72-6e487e44ec2b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:43.815418 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-534db0c1-484f-44ba-9d72-6e487e44ec2b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:43.825218 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-534db0c1-484f-44ba-9d72-6e487e44ec2b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.461993 May 16 18:57:43.831794 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 507/1038] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:43 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:44.851211 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-35f8ccdf-75d2-40ad-98f8-c12fc51a81ac tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:44.852176 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-35f8ccdf-75d2-40ad-98f8-c12fc51a81ac tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:44.858783 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35f8ccdf-75d2-40ad-98f8-c12fc51a81ac tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:44.859237 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35f8ccdf-75d2-40ad-98f8-c12fc51a81ac tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:44.860305 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35f8ccdf-75d2-40ad-98f8-c12fc51a81ac tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:44.860988 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-35f8ccdf-75d2-40ad-98f8-c12fc51a81ac tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:45.003776 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-35f8ccdf-75d2-40ad-98f8-c12fc51a81ac tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:45.012777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-35f8ccdf-75d2-40ad-98f8-c12fc51a81ac tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.166005 May 16 18:57:45.013326 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 532/1039] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:44 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:46.029127 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-4f4d87c7-0896-4457-8a9b-d98b4ba1b002 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:46.029805 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-4f4d87c7-0896-4457-8a9b-d98b4ba1b002 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:46.038855 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4f4d87c7-0896-4457-8a9b-d98b4ba1b002 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:46.039319 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4f4d87c7-0896-4457-8a9b-d98b4ba1b002 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:46.040523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4f4d87c7-0896-4457-8a9b-d98b4ba1b002 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:46.041083 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-4f4d87c7-0896-4457-8a9b-d98b4ba1b002 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:46.223426 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-4f4d87c7-0896-4457-8a9b-d98b4ba1b002 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:46.231618 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-4f4d87c7-0896-4457-8a9b-d98b4ba1b002 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.206492 May 16 18:57:46.232261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 508/1040] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:46 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:57:47.255969 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-08ec0302-c343-4c06-be64-d9cc60121f7f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:47.256771 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-08ec0302-c343-4c06-be64-d9cc60121f7f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:47.265914 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08ec0302-c343-4c06-be64-d9cc60121f7f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:47.266365 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08ec0302-c343-4c06-be64-d9cc60121f7f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:47.267177 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08ec0302-c343-4c06-be64-d9cc60121f7f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:47.267616 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08ec0302-c343-4c06-be64-d9cc60121f7f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:47.416458 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-08ec0302-c343-4c06-be64-d9cc60121f7f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:47.425670 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-08ec0302-c343-4c06-be64-d9cc60121f7f tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.174439 May 16 18:57:47.426253 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 533/1041] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:47 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:48.443475 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9ee0e8dc-6890-4af6-b157-e6e61f94013c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:48.444203 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9ee0e8dc-6890-4af6-b157-e6e61f94013c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:48.450597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9ee0e8dc-6890-4af6-b157-e6e61f94013c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:48.451075 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9ee0e8dc-6890-4af6-b157-e6e61f94013c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:48.451892 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9ee0e8dc-6890-4af6-b157-e6e61f94013c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:48.452324 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9ee0e8dc-6890-4af6-b157-e6e61f94013c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:48.616103 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9ee0e8dc-6890-4af6-b157-e6e61f94013c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:48.628798 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9ee0e8dc-6890-4af6-b157-e6e61f94013c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.189050 May 16 18:57:48.629452 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 509/1042] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:48 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:49.652030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-9b01a63a-92b4-4d7b-8df7-a4e6a4090ba2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:49.652865 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-9b01a63a-92b4-4d7b-8df7-a4e6a4090ba2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:49.661359 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9b01a63a-92b4-4d7b-8df7-a4e6a4090ba2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:49.661989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9b01a63a-92b4-4d7b-8df7-a4e6a4090ba2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:49.663484 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9b01a63a-92b4-4d7b-8df7-a4e6a4090ba2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:49.664362 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-9b01a63a-92b4-4d7b-8df7-a4e6a4090ba2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:49.823432 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-9b01a63a-92b4-4d7b-8df7-a4e6a4090ba2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:49.832122 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-9b01a63a-92b4-4d7b-8df7-a4e6a4090ba2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.186225 May 16 18:57:49.832685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 534/1043] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:49 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:50.851939 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b64f55f8-313b-43f9-9422-0d04c3229881 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:50.852968 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b64f55f8-313b-43f9-9422-0d04c3229881 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:50.862188 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b64f55f8-313b-43f9-9422-0d04c3229881 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:50.862634 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b64f55f8-313b-43f9-9422-0d04c3229881 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:50.864863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b64f55f8-313b-43f9-9422-0d04c3229881 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:50.864863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b64f55f8-313b-43f9-9422-0d04c3229881 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:51.032319 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b64f55f8-313b-43f9-9422-0d04c3229881 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:51.040504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b64f55f8-313b-43f9-9422-0d04c3229881 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.192664 May 16 18:57:51.041064 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 510/1044] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:50 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:52.059155 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d1c46535-51ea-4108-96cb-6c71b1ac1da2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:52.060110 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d1c46535-51ea-4108-96cb-6c71b1ac1da2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:52.073414 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1c46535-51ea-4108-96cb-6c71b1ac1da2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:52.077519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1c46535-51ea-4108-96cb-6c71b1ac1da2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:52.079494 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1c46535-51ea-4108-96cb-6c71b1ac1da2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:52.079969 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d1c46535-51ea-4108-96cb-6c71b1ac1da2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:52.283334 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d1c46535-51ea-4108-96cb-6c71b1ac1da2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:52.300481 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d1c46535-51ea-4108-96cb-6c71b1ac1da2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.245862 May 16 18:57:52.301078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 535/1045] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:52 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:53.329561 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-de5b8ac0-add6-4ffe-b038-01fa9443e3cc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:53.330452 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-de5b8ac0-add6-4ffe-b038-01fa9443e3cc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:53.336999 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-de5b8ac0-add6-4ffe-b038-01fa9443e3cc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:53.337451 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-de5b8ac0-add6-4ffe-b038-01fa9443e3cc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:53.338239 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-de5b8ac0-add6-4ffe-b038-01fa9443e3cc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:53.338684 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-de5b8ac0-add6-4ffe-b038-01fa9443e3cc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:53.497309 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-de5b8ac0-add6-4ffe-b038-01fa9443e3cc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:53.505998 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-de5b8ac0-add6-4ffe-b038-01fa9443e3cc tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.183088 May 16 18:57:53.506568 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 511/1046] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:53 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:54.522862 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-50277ef9-a196-436d-9407-511d1cb44826 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:54.523439 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-50277ef9-a196-436d-9407-511d1cb44826 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:54.529865 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50277ef9-a196-436d-9407-511d1cb44826 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:54.530312 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50277ef9-a196-436d-9407-511d1cb44826 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:54.531084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50277ef9-a196-436d-9407-511d1cb44826 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:54.531515 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-50277ef9-a196-436d-9407-511d1cb44826 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:54.673681 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-50277ef9-a196-436d-9407-511d1cb44826 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:54.684842 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-50277ef9-a196-436d-9407-511d1cb44826 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.165652 May 16 18:57:54.685727 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 536/1047] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:54 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:55.128271 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-13e2c9ed-09fa-4e0a-a810-0b162b120652 req-007e067d-10bb-480c-a47f-8382890e7de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a9c223-ae61-46b2-b25b-e996c79938c2", "name": "network-vif-plugged", "status": "completed", "tag": "f3724a00-7e9f-4041-8edf-d95832fa4fc7"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:57:55.138763 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-13e2c9ed-09fa-4e0a-a810-0b162b120652 req-007e067d-10bb-480c-a47f-8382890e7de1 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:55.139404 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-13e2c9ed-09fa-4e0a-a810-0b162b120652 req-007e067d-10bb-480c-a47f-8382890e7de1 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:55.152161 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-13e2c9ed-09fa-4e0a-a810-0b162b120652 req-007e067d-10bb-480c-a47f-8382890e7de1 service nova] Creating event network-vif-plugged:f3724a00-7e9f-4041-8edf-d95832fa4fc7 for instance 97a9c223-ae61-46b2-b25b-e996c79938c2 on hv-cinder-75078 May 16 18:57:55.158249 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-13e2c9ed-09fa-4e0a-a810-0b162b120652 req-007e067d-10bb-480c-a47f-8382890e7de1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034108 May 16 18:57:55.159149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 512/1048] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:57:55.710066 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-d2ad4f09-4fb3-47fe-bb5e-43389373e46c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:55.711296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-d2ad4f09-4fb3-47fe-bb5e-43389373e46c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:55.719108 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2ad4f09-4fb3-47fe-bb5e-43389373e46c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:55.719610 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2ad4f09-4fb3-47fe-bb5e-43389373e46c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:55.720431 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2ad4f09-4fb3-47fe-bb5e-43389373e46c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:55.720870 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-d2ad4f09-4fb3-47fe-bb5e-43389373e46c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:55.907848 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-d2ad4f09-4fb3-47fe-bb5e-43389373e46c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:55.917693 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-d2ad4f09-4fb3-47fe-bb5e-43389373e46c tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.212972 May 16 18:57:55.918319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 537/1049] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:55 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:56.937366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ade60e32-ffbf-4925-b447-c63b4fe766a2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:56.938261 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ade60e32-ffbf-4925-b447-c63b4fe766a2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:56.945144 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ade60e32-ffbf-4925-b447-c63b4fe766a2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:56.945690 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ade60e32-ffbf-4925-b447-c63b4fe766a2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:56.946509 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ade60e32-ffbf-4925-b447-c63b4fe766a2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:56.946982 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ade60e32-ffbf-4925-b447-c63b4fe766a2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:57.110690 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ade60e32-ffbf-4925-b447-c63b4fe766a2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:57.131024 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ade60e32-ffbf-4925-b447-c63b4fe766a2 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1266 microversion: 2.1 time: 0.199592 May 16 18:57:57.131623 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 513/1050] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:56 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:58.148677 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-972709fb-1725-40d4-bf21-c07acb4a2986 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:58.149308 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-972709fb-1725-40d4-bf21-c07acb4a2986 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:58.155772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-972709fb-1725-40d4-bf21-c07acb4a2986 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:58.156234 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-972709fb-1725-40d4-bf21-c07acb4a2986 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:58.157601 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-972709fb-1725-40d4-bf21-c07acb4a2986 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:58.158040 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-972709fb-1725-40d4-bf21-c07acb4a2986 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:58.313999 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-972709fb-1725-40d4-bf21-c07acb4a2986 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:58.321973 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-972709fb-1725-40d4-bf21-c07acb4a2986 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1453 microversion: 2.1 time: 0.177325 May 16 18:57:58.322549 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 538/1051] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:58 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:57:58.338614 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-d3429705-5530-4d72-8842-451b746d80d9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:57:58.339230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-d3429705-5530-4d72-8842-451b746d80d9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:57:58.347056 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3429705-5530-4d72-8842-451b746d80d9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:58.347516 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3429705-5530-4d72-8842-451b746d80d9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:58.348333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3429705-5530-4d72-8842-451b746d80d9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:57:58.348777 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-d3429705-5530-4d72-8842-451b746d80d9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:57:58.535667 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-d3429705-5530-4d72-8842-451b746d80d9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:57:58.545441 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-d3429705-5530-4d72-8842-451b746d80d9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1453 microversion: 2.1 time: 0.210672 May 16 18:57:58.546021 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 514/1052] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:57:58 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1453 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:58:00.831419 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-2e1bc42c-13a2-448d-ab14-69d12d0f4a0a req-60789f64-8a3c-42df-a64b-26d2d3276443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97a9c223-ae61-46b2-b25b-e996c79938c2", "tag": "f3724a00-7e9f-4041-8edf-d95832fa4fc7"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:58:00.843813 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-2e1bc42c-13a2-448d-ab14-69d12d0f4a0a req-60789f64-8a3c-42df-a64b-26d2d3276443 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:00.845180 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-2e1bc42c-13a2-448d-ab14-69d12d0f4a0a req-60789f64-8a3c-42df-a64b-26d2d3276443 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:00.858984 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-2e1bc42c-13a2-448d-ab14-69d12d0f4a0a req-60789f64-8a3c-42df-a64b-26d2d3276443 service nova] Creating event network-changed:f3724a00-7e9f-4041-8edf-d95832fa4fc7 for instance 97a9c223-ae61-46b2-b25b-e996c79938c2 on hv-cinder-75078 May 16 18:58:00.866812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-2e1bc42c-13a2-448d-ab14-69d12d0f4a0a req-60789f64-8a3c-42df-a64b-26d2d3276443 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042303 May 16 18:58:00.868083 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 539/1053] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:58:05.058448 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-000ee355-1bf1-4638-a606-f1730c45ca94 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "937846cc-a583-4cc4-b489-cab97babc624", "device": "/dev/sdb"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:58:05.060866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-000ee355-1bf1-4638-a606-f1730c45ca94 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:05.067977 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-000ee355-1bf1-4638-a606-f1730c45ca94 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:05.068420 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-000ee355-1bf1-4638-a606-f1730c45ca94 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:05.069208 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-000ee355-1bf1-4638-a606-f1730c45ca94 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:05.069647 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-000ee355-1bf1-4638-a606-f1730c45ca94 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:05.355586 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-000ee355-1bf1-4638-a606-f1730c45ca94 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "POST /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302256 May 16 18:58:05.356276 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 515/1054] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:58:05 2022] POST /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:58:33.375399 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0ef8e875-6f63-40be-aec9-953404ad4438 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:33.376174 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0ef8e875-6f63-40be-aec9-953404ad4438 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:33.382540 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0ef8e875-6f63-40be-aec9-953404ad4438 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:33.382995 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0ef8e875-6f63-40be-aec9-953404ad4438 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:33.383812 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0ef8e875-6f63-40be-aec9-953404ad4438 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:33.384253 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0ef8e875-6f63-40be-aec9-953404ad4438 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:33.477796 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-0ef8e875-6f63-40be-aec9-953404ad4438 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lazy-loading 'services' on Instance uuid 5303dd81-d9ae-49a9-8d35-f7584e91aecc {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:58:33.565753 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0ef8e875-6f63-40be-aec9-953404ad4438 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "DELETE /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc/os-volume_attachments/937846cc-a583-4cc4-b489-cab97babc624" status: 202 len: 0 microversion: 2.1 time: 0.195828 May 16 18:58:33.567023 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 540/1055] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 18:58:33 2022] DELETE /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc/os-volume_attachments/937846cc-a583-4cc4-b489-cab97babc624 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:58:34.723754 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-054b9a2a-3368-4b9f-9a95-bab58dd039e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:34.724374 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-054b9a2a-3368-4b9f-9a95-bab58dd039e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:34.730561 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-054b9a2a-3368-4b9f-9a95-bab58dd039e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:34.731015 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-054b9a2a-3368-4b9f-9a95-bab58dd039e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:34.731820 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-054b9a2a-3368-4b9f-9a95-bab58dd039e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:34.732256 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-054b9a2a-3368-4b9f-9a95-bab58dd039e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:34.758435 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-054b9a2a-3368-4b9f-9a95-bab58dd039e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:58:34.848443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-054b9a2a-3368-4b9f-9a95-bab58dd039e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "DELETE /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 204 len: 0 microversion: 2.1 time: 0.128949 May 16 18:58:34.849232 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 516/1056] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:58:34 2022] DELETE /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 18:58:34.860280 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-dc8ae58a-d96e-4f32-87aa-6f470d070a63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:34.861009 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-dc8ae58a-d96e-4f32-87aa-6f470d070a63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:34.867429 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dc8ae58a-d96e-4f32-87aa-6f470d070a63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:34.867884 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dc8ae58a-d96e-4f32-87aa-6f470d070a63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:34.869948 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dc8ae58a-d96e-4f32-87aa-6f470d070a63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:34.869948 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dc8ae58a-d96e-4f32-87aa-6f470d070a63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:35.024329 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dc8ae58a-d96e-4f32-87aa-6f470d070a63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:35.036234 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-dc8ae58a-d96e-4f32-87aa-6f470d070a63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1514 microversion: 2.1 time: 0.180948 May 16 18:58:35.037125 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 541/1057] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:34 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:58:36.057118 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c4a67cc9-d7a9-483d-bb7b-6cf81db55001 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:36.057829 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c4a67cc9-d7a9-483d-bb7b-6cf81db55001 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:36.065718 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4a67cc9-d7a9-483d-bb7b-6cf81db55001 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:36.066345 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4a67cc9-d7a9-483d-bb7b-6cf81db55001 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:36.067124 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4a67cc9-d7a9-483d-bb7b-6cf81db55001 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:36.067405 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c4a67cc9-d7a9-483d-bb7b-6cf81db55001 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:36.219934 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c4a67cc9-d7a9-483d-bb7b-6cf81db55001 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:36.227826 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c4a67cc9-d7a9-483d-bb7b-6cf81db55001 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1514 microversion: 2.1 time: 0.175006 May 16 18:58:36.228414 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 517/1058] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:36 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:58:37.068519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-798914e4-d9e9-4efd-b0c6-4e0b8619b6ea req-33b47ed3-894a-45dc-9f05-6b336c7258d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5303dd81-d9ae-49a9-8d35-f7584e91aecc", "name": "network-vif-deleted", "tag": "451d3565-ef78-43e5-aa1f-1741fb7624c4"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:58:37.078063 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-798914e4-d9e9-4efd-b0c6-4e0b8619b6ea req-33b47ed3-894a-45dc-9f05-6b336c7258d2 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:37.078189 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-798914e4-d9e9-4efd-b0c6-4e0b8619b6ea req-33b47ed3-894a-45dc-9f05-6b336c7258d2 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:37.090788 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-798914e4-d9e9-4efd-b0c6-4e0b8619b6ea req-33b47ed3-894a-45dc-9f05-6b336c7258d2 service nova] Creating event network-vif-deleted:451d3565-ef78-43e5-aa1f-1741fb7624c4 for instance 5303dd81-d9ae-49a9-8d35-f7584e91aecc on hv-cinder-75078 May 16 18:58:37.095957 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-798914e4-d9e9-4efd-b0c6-4e0b8619b6ea req-33b47ed3-894a-45dc-9f05-6b336c7258d2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030942 May 16 18:58:37.096554 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 542/1059] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:58:37.247262 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:37.247964 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:37.254904 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:37.255354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:37.256169 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:37.256607 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:37.294466 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:37.294915 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:37.295369 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lazy-loading 'fault' on Instance uuid 5303dd81-d9ae-49a9-8d35-f7584e91aecc {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:58:37.318424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 18:58:37.318705 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Mon May 16 18:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 18:58:37.363298 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:37.371677 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e2fb1dac-6e0b-48b5-a717-e04b6777334e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 200 len: 1308 microversion: 2.1 time: 0.128464 May 16 18:58:37.372360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 518/1060] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:37 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:58:38.393993 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4b210083-e957-4a80-946a-28fefefd48ec tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:38.394708 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-4b210083-e957-4a80-946a-28fefefd48ec tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 5303dd81-d9ae-49a9-8d35-f7584e91aecc] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:38.402054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4b210083-e957-4a80-946a-28fefefd48ec tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:38.402543 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4b210083-e957-4a80-946a-28fefefd48ec tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:38.403323 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4b210083-e957-4a80-946a-28fefefd48ec tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:38.403818 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-4b210083-e957-4a80-946a-28fefefd48ec tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:38.417936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-4b210083-e957-4a80-946a-28fefefd48ec tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] HTTP exception thrown: Instance 5303dd81-d9ae-49a9-8d35-f7584e91aecc could not be found. May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4b210083-e957-4a80-946a-28fefefd48ec tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Request method failure captured: May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc HTTP/1.1 May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigp6PNBpOSZfdpGmjQldkri1czAaM71Yxh9m5bb0HvuPue-k4SKPrA-Vedx0aR5L_k-syXUNe5E4IL6-37BrbDE1kT_6X_O2dnH1cdU_5dBqbNxBVe93GdKcmtrr3905DdwJSuw5wYLs3lM8y9xEqD9B8XH6-1J7lUeNhQXD2s4bbNWo May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 9cf09aab60304f30ae52a87b7b1ea81a May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-VolumesSnapshotTestJSON-448911475 May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 18:58:38.419503 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9cf09aab60304f30ae52a87b7b1ea81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cf09aab60304f30ae52a87b7b1ea81a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cf09aab60304f30ae52a87b7b1ea81a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9cf09aab60304f30ae52a87b7b1ea81a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-VolumesSnapshotTestJSON-448911475 May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 9cf09aab60304f30ae52a87b7b1ea81a May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-448911475 May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-VolumesSnapshotTestJSON-448911475-project May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 9cb61d5251e74d529a6bfa7d3a684123 May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-VolumesSnapshotTestJSON-448911475-project May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance 5303dd81-d9ae-49a9-8d35-f7584e91aecc could not be found. May 16 18:58:38.420961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': '5303dd81-d9ae-49a9-8d35-f7584e91aecc'} May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5303dd81-d9ae-49a9-8d35-f7584e91aecc could not be found. May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:58:38.423650 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5303dd81-d9ae-49a9-8d35-f7584e91aecc could not be found. May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5303dd81-d9ae-49a9-8d35-f7584e91aecc could not be found. May 16 18:58:38.425164 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 18:58:38.426453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-4b210083-e957-4a80-946a-28fefefd48ec tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Returning 404 to user: Instance 5303dd81-d9ae-49a9-8d35-f7584e91aecc could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:58:38.426453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-4b210083-e957-4a80-946a-28fefefd48ec tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc" status: 404 len: 111 microversion: 2.1 time: 0.031615 May 16 18:58:38.426453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 543/1061] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:38 2022] GET /compute/v2.1/servers/5303dd81-d9ae-49a9-8d35-f7584e91aecc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:58:48.507240 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-417206621", "imageRef": "f4588f8a-10dc-4339-990a-2df5d7f0afba", "flavorRef": "452", "networks": [{"uuid": "b95187d3-253b-461a-b026-7d62a560dcd2"}]}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:58:48.830079 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] validate_networks() for [('b95187d3-253b-461a-b026-7d62a560dcd2', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:58:49.316169 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:58:49.316935 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:58:49.317392 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:58:49.317812 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:58:49.318404 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:58:49.331188 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:49.332271 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:49.335085 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:49.335781 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:49.355079 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Getting quotas for project 9cf09aab60304f30ae52a87b7b1ea81a. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:58:49.360151 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Getting quotas for user 9cb61d5251e74d529a6bfa7d3a684123 and project 9cf09aab60304f30ae52a87b7b1ea81a. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:58:49.374354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:58:49.376649 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4588f8a-10dc-4339-990a-2df5d7f0afba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:58:49.430398 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ae34acf3-0709-4325-aecd-da6d628f10b7 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926859 May 16 18:58:49.431926 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 519/1062] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:58:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:58:49.441699 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-69ef3ecb-d6c2-4600-a2c9-0d6ec5c2a92f tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:49.442313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-69ef3ecb-d6c2-4600-a2c9-0d6ec5c2a92f tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:49.644299 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-69ef3ecb-d6c2-4600-a2c9-0d6ec5c2a92f tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:49.651965 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-69ef3ecb-d6c2-4600-a2c9-0d6ec5c2a92f tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1218 microversion: 2.1 time: 0.214063 May 16 18:58:49.652618 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 544/1063] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:49 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:58:50.672394 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2676f7f0-9681-4a36-a514-21eaa91e8203 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:50.672929 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2676f7f0-9681-4a36-a514-21eaa91e8203 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:50.699108 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2676f7f0-9681-4a36-a514-21eaa91e8203 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:50.704366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2676f7f0-9681-4a36-a514-21eaa91e8203 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:50.705507 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2676f7f0-9681-4a36-a514-21eaa91e8203 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:50.706030 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2676f7f0-9681-4a36-a514-21eaa91e8203 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:50.854371 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2676f7f0-9681-4a36-a514-21eaa91e8203 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:50.868540 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2676f7f0-9681-4a36-a514-21eaa91e8203 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1270 microversion: 2.1 time: 0.201604 May 16 18:58:50.878356 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 520/1064] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:50 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:58:51.895745 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-71219394-2838-466c-894b-2d0c33f4d9b6 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:51.896991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-71219394-2838-466c-894b-2d0c33f4d9b6 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:51.907407 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-71219394-2838-466c-894b-2d0c33f4d9b6 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:51.907893 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-71219394-2838-466c-894b-2d0c33f4d9b6 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:51.908747 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-71219394-2838-466c-894b-2d0c33f4d9b6 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:51.909253 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-71219394-2838-466c-894b-2d0c33f4d9b6 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:52.153533 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-71219394-2838-466c-894b-2d0c33f4d9b6 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:52.165295 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-71219394-2838-466c-894b-2d0c33f4d9b6 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1318 microversion: 2.1 time: 0.271626 May 16 18:58:52.165996 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 545/1065] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:51 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:58:53.013438 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-95f81752-0a03-4c3f-9566-b7270ea88d78 req-2f6e8468-4cef-4816-a9e6-35054c2ea7ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "481cae72-0842-4a6c-923a-f53aa1653c92", "tag": "3aa20307-2122-4b8c-bcdb-38e24f4e8abc"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:58:53.030848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-95f81752-0a03-4c3f-9566-b7270ea88d78 req-2f6e8468-4cef-4816-a9e6-35054c2ea7ab service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:53.031293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-95f81752-0a03-4c3f-9566-b7270ea88d78 req-2f6e8468-4cef-4816-a9e6-35054c2ea7ab service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:53.068984 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-95f81752-0a03-4c3f-9566-b7270ea88d78 req-2f6e8468-4cef-4816-a9e6-35054c2ea7ab service nova] Creating event network-changed:3aa20307-2122-4b8c-bcdb-38e24f4e8abc for instance 481cae72-0842-4a6c-923a-f53aa1653c92 on hv-cinder-75078 May 16 18:58:53.078079 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-95f81752-0a03-4c3f-9566-b7270ea88d78 req-2f6e8468-4cef-4816-a9e6-35054c2ea7ab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067986 May 16 18:58:53.079475 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 521/1066] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:58:53.184859 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c57a9885-576a-4e6e-96cd-cce40c1d9c53 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:53.185477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c57a9885-576a-4e6e-96cd-cce40c1d9c53 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:53.200331 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c57a9885-576a-4e6e-96cd-cce40c1d9c53 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:53.200777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c57a9885-576a-4e6e-96cd-cce40c1d9c53 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:53.202485 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c57a9885-576a-4e6e-96cd-cce40c1d9c53 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:53.203405 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c57a9885-576a-4e6e-96cd-cce40c1d9c53 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:53.561843 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c57a9885-576a-4e6e-96cd-cce40c1d9c53 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:53.593704 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c57a9885-576a-4e6e-96cd-cce40c1d9c53 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1318 microversion: 2.1 time: 0.413478 May 16 18:58:53.605268 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 546/1067] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:53 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:58:54.615598 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-051e6ca5-7336-4c83-a22e-9f9bfb3ea1e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:54.616528 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-051e6ca5-7336-4c83-a22e-9f9bfb3ea1e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:54.623450 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-051e6ca5-7336-4c83-a22e-9f9bfb3ea1e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:54.624597 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-051e6ca5-7336-4c83-a22e-9f9bfb3ea1e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:54.626578 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-051e6ca5-7336-4c83-a22e-9f9bfb3ea1e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:54.627215 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-051e6ca5-7336-4c83-a22e-9f9bfb3ea1e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:54.881337 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-051e6ca5-7336-4c83-a22e-9f9bfb3ea1e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:54.891391 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-051e6ca5-7336-4c83-a22e-9f9bfb3ea1e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1318 microversion: 2.1 time: 0.282665 May 16 18:58:54.902386 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 522/1068] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:54 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:58:55.908857 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-56f90445-c88d-4254-9534-ab5d8163da5a tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:55.909828 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-56f90445-c88d-4254-9534-ab5d8163da5a tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:55.920176 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-56f90445-c88d-4254-9534-ab5d8163da5a tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:55.920649 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-56f90445-c88d-4254-9534-ab5d8163da5a tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:55.921910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-56f90445-c88d-4254-9534-ab5d8163da5a tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:55.923165 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-56f90445-c88d-4254-9534-ab5d8163da5a tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:56.132458 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-56f90445-c88d-4254-9534-ab5d8163da5a tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:56.141962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-56f90445-c88d-4254-9534-ab5d8163da5a tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1318 microversion: 2.1 time: 0.237624 May 16 18:58:56.143153 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 547/1069] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:55 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:58:57.166600 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0585a0ef-152f-484c-9c0d-61ae8c20c581 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:57.167339 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0585a0ef-152f-484c-9c0d-61ae8c20c581 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:57.174644 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0585a0ef-152f-484c-9c0d-61ae8c20c581 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:57.175102 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0585a0ef-152f-484c-9c0d-61ae8c20c581 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:57.175959 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0585a0ef-152f-484c-9c0d-61ae8c20c581 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:57.176409 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0585a0ef-152f-484c-9c0d-61ae8c20c581 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:57.333730 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0585a0ef-152f-484c-9c0d-61ae8c20c581 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:57.350470 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0585a0ef-152f-484c-9c0d-61ae8c20c581 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1318 microversion: 2.1 time: 0.191928 May 16 18:58:57.351061 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 523/1070] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:57 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:58:58.371603 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c1e51c1e-b0bf-4058-b8d3-9f5d5e681552 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:58.374453 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c1e51c1e-b0bf-4058-b8d3-9f5d5e681552 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:58.385561 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c1e51c1e-b0bf-4058-b8d3-9f5d5e681552 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:58.386961 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c1e51c1e-b0bf-4058-b8d3-9f5d5e681552 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:58.388787 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c1e51c1e-b0bf-4058-b8d3-9f5d5e681552 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:58.390957 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c1e51c1e-b0bf-4058-b8d3-9f5d5e681552 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:58.565090 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c1e51c1e-b0bf-4058-b8d3-9f5d5e681552 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:58.572732 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c1e51c1e-b0bf-4058-b8d3-9f5d5e681552 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1318 microversion: 2.1 time: 0.208088 May 16 18:58:58.573393 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 548/1071] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:58 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:58:59.526502 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-e621630b-9c11-4f56-83df-171d538e4b95 req-7327120f-85d4-4d23-b2c9-9bb5879c33d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "481cae72-0842-4a6c-923a-f53aa1653c92", "name": "network-vif-plugged", "status": "completed", "tag": "3aa20307-2122-4b8c-bcdb-38e24f4e8abc"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:58:59.537409 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-e621630b-9c11-4f56-83df-171d538e4b95 req-7327120f-85d4-4d23-b2c9-9bb5879c33d4 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:59.538154 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-e621630b-9c11-4f56-83df-171d538e4b95 req-7327120f-85d4-4d23-b2c9-9bb5879c33d4 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:59.552018 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-e621630b-9c11-4f56-83df-171d538e4b95 req-7327120f-85d4-4d23-b2c9-9bb5879c33d4 service nova] Creating event network-vif-plugged:3aa20307-2122-4b8c-bcdb-38e24f4e8abc for instance 481cae72-0842-4a6c-923a-f53aa1653c92 on hv-cinder-75078 May 16 18:58:59.558271 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-e621630b-9c11-4f56-83df-171d538e4b95 req-7327120f-85d4-4d23-b2c9-9bb5879c33d4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035363 May 16 18:58:59.559253 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 524/1072] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:58:59.609722 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7c376107-6879-4527-baa9-b45d63ea6b63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:58:59.615689 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7c376107-6879-4527-baa9-b45d63ea6b63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:58:59.623153 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c376107-6879-4527-baa9-b45d63ea6b63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:59.624597 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c376107-6879-4527-baa9-b45d63ea6b63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:59.626051 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c376107-6879-4527-baa9-b45d63ea6b63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:58:59.626575 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7c376107-6879-4527-baa9-b45d63ea6b63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:58:59.786707 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b4127d31-e84e-4b75-9039-cf047adb7ca1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Action: 'create', calling method: .version_select at 0x7f6468411160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1523465501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNONCNTMn+CBDtZQLfRvHf/Kh5t69Tj8P53c5aHuI59NHcV/XkZ/SQUpGTz4g3g4Vvd88dRca8DBV1qILEanlGdIce6WPje4krbujkF06GQUDriaWnl2fZX8oSzJSuw7ug=="}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:58:59.801070 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-b4127d31-e84e-4b75-9039-cf047adb7ca1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Getting quotas for project bb467769134a4df0bb4608a8283e8dda. Resources: {'key_pairs'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:58:59.804971 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-b4127d31-e84e-4b75-9039-cf047adb7ca1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Getting quotas for user 0bacbe5d174842debcc440335a91659d and project bb467769134a4df0bb4608a8283e8dda. Resources: {'key_pairs'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:58:59.831198 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b4127d31-e84e-4b75-9039-cf047adb7ca1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048562 May 16 18:58:59.832118 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 525/1073] 10.222.0.72 () {60 vars in 1158 bytes} [Mon May 16 18:58:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:58:59.842701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7c376107-6879-4527-baa9-b45d63ea6b63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:58:59.848389 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7c376107-6879-4527-baa9-b45d63ea6b63 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1318 microversion: 2.1 time: 0.249053 May 16 18:58:59.850153 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 549/1074] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:58:59 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:58:59.883366 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-236627524", "imageRef": "e7e8ba79-7880-4522-9a04-2751410fe536", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1523465501", "networks": [{"uuid": "197c1b72-74cd-4af0-b3fe-924ab553e62b"}]}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:58:59.939396 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.network.neutron [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] validate_networks() for [('197c1b72-74cd-4af0-b3fe-924ab553e62b', None, None, None, None, None)] {{(pid=128887) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 18:59:00.342877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Flavor limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 18:59:00.343306 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Image limits 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 18:59:00.343806 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Flavor pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 18:59:00.344226 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Image pref 0:0:0 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 18:59:00.344808 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.virt.hardware [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 18:59:00.353974 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:00.354423 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:00.355250 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:00.355687 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:00.374130 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Getting quotas for project bb467769134a4df0bb4608a8283e8dda. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 18:59:00.378901 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.quota [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Getting quotas for user 0bacbe5d174842debcc440335a91659d and project bb467769134a4df0bb4608a8283e8dda. Resources: {'ram', 'cores', 'instances'} {{(pid=128887) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 18:59:00.391530 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Going to run 1 instances... {{(pid=128887) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 18:59:00.393866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7e8ba79-7880-4522-9a04-2751410fe536',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 18:59:00.462869 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-900d0536-deee-4a4a-a68c-601092403eb7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583278 May 16 18:59:00.463518 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 526/1075] 10.222.0.72 () {60 vars in 1146 bytes} [Mon May 16 18:58:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 18:59:00.476825 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-62cfa805-6a71-4689-9baa-ac394578eea8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:00.477491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-62cfa805-6a71-4689-9baa-ac394578eea8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:00.547249 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-62cfa805-6a71-4689-9baa-ac394578eea8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:00.556353 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-62cfa805-6a71-4689-9baa-ac394578eea8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1258 microversion: 2.1 time: 0.085499 May 16 18:59:00.557500 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 550/1076] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:00 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:00.871046 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-13414b3a-bf98-4050-be04-180aa9ec27f0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:00.871920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-13414b3a-bf98-4050-be04-180aa9ec27f0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:00.884240 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-13414b3a-bf98-4050-be04-180aa9ec27f0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:00.885068 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-13414b3a-bf98-4050-be04-180aa9ec27f0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:00.886478 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-13414b3a-bf98-4050-be04-180aa9ec27f0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:00.887299 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-13414b3a-bf98-4050-be04-180aa9ec27f0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:01.054920 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-13414b3a-bf98-4050-be04-180aa9ec27f0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:01.064919 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-13414b3a-bf98-4050-be04-180aa9ec27f0 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1318 microversion: 2.1 time: 0.200276 May 16 18:59:01.065497 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 527/1077] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:00 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:01.578018 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c2cd49f2-3b2b-4e3e-aff5-2eb355290f36 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:01.578651 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c2cd49f2-3b2b-4e3e-aff5-2eb355290f36 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:01.586171 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c2cd49f2-3b2b-4e3e-aff5-2eb355290f36 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:01.586628 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c2cd49f2-3b2b-4e3e-aff5-2eb355290f36 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:01.587402 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c2cd49f2-3b2b-4e3e-aff5-2eb355290f36 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:01.587869 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c2cd49f2-3b2b-4e3e-aff5-2eb355290f36 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:01.660308 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c2cd49f2-3b2b-4e3e-aff5-2eb355290f36 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:01.671878 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c2cd49f2-3b2b-4e3e-aff5-2eb355290f36 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1254 microversion: 2.1 time: 0.098303 May 16 18:59:01.672482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 551/1078] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:01 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1254 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:02.087728 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-bab6762d-057d-4c3a-a949-87bfc74523e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:02.088836 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-bab6762d-057d-4c3a-a949-87bfc74523e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:02.102517 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bab6762d-057d-4c3a-a949-87bfc74523e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:02.103690 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bab6762d-057d-4c3a-a949-87bfc74523e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:02.105377 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bab6762d-057d-4c3a-a949-87bfc74523e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:02.106424 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-bab6762d-057d-4c3a-a949-87bfc74523e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:02.658263 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-bab6762d-057d-4c3a-a949-87bfc74523e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:02.678815 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-bab6762d-057d-4c3a-a949-87bfc74523e2 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1507 microversion: 2.1 time: 0.598304 May 16 18:59:02.681416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 528/1079] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:02 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1507 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:02.691020 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5eee2723-39ce-4160-a003-b6808f28809d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:02.692937 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5eee2723-39ce-4160-a003-b6808f28809d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:02.711065 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5eee2723-39ce-4160-a003-b6808f28809d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:02.713588 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5eee2723-39ce-4160-a003-b6808f28809d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:02.716243 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-05acf20f-c4f5-4edb-adc5-522332f330e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51bc3de1-a3e4-48f7-90bf-8cd30b4651b4", "device": "/dev/sdb"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:59:02.719096 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5eee2723-39ce-4160-a003-b6808f28809d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:02.720183 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5eee2723-39ce-4160-a003-b6808f28809d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:02.724796 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-05acf20f-c4f5-4edb-adc5-522332f330e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:02.751406 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-05acf20f-c4f5-4edb-adc5-522332f330e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:02.752503 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-05acf20f-c4f5-4edb-adc5-522332f330e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:02.757272 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-05acf20f-c4f5-4edb-adc5-522332f330e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:02.759333 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-05acf20f-c4f5-4edb-adc5-522332f330e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:02.864209 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5eee2723-39ce-4160-a003-b6808f28809d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:02.877330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5eee2723-39ce-4160-a003-b6808f28809d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1316 microversion: 2.1 time: 0.191871 May 16 18:59:02.879135 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 552/1080] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:02 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:03.901864 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a6e91247-b811-4c7e-8c90-03db213c9591 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:03.903197 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a6e91247-b811-4c7e-8c90-03db213c9591 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:03.914410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6e91247-b811-4c7e-8c90-03db213c9591 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:03.915512 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6e91247-b811-4c7e-8c90-03db213c9591 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:03.917104 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6e91247-b811-4c7e-8c90-03db213c9591 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:03.918056 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6e91247-b811-4c7e-8c90-03db213c9591 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:04.093308 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a6e91247-b811-4c7e-8c90-03db213c9591 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:04.105438 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a6e91247-b811-4c7e-8c90-03db213c9591 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.210303 May 16 18:59:04.106945 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 553/1081] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:03 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:05.127176 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-848303e3-60b5-40c5-a471-cb567eee38fd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:05.128529 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-848303e3-60b5-40c5-a471-cb567eee38fd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:05.137867 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-848303e3-60b5-40c5-a471-cb567eee38fd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:05.138869 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-848303e3-60b5-40c5-a471-cb567eee38fd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:05.140948 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-848303e3-60b5-40c5-a471-cb567eee38fd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:05.141420 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-848303e3-60b5-40c5-a471-cb567eee38fd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:05.295532 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-848303e3-60b5-40c5-a471-cb567eee38fd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:05.305130 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-848303e3-60b5-40c5-a471-cb567eee38fd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.184548 May 16 18:59:05.305989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 554/1082] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:05 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:59:06.327350 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ebc86acd-755e-4dfe-920f-db8755f9218c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:06.328043 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ebc86acd-755e-4dfe-920f-db8755f9218c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:06.336491 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ebc86acd-755e-4dfe-920f-db8755f9218c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:06.337303 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ebc86acd-755e-4dfe-920f-db8755f9218c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:06.338680 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ebc86acd-755e-4dfe-920f-db8755f9218c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:06.339464 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ebc86acd-755e-4dfe-920f-db8755f9218c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:06.508949 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ebc86acd-755e-4dfe-920f-db8755f9218c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:06.517586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ebc86acd-755e-4dfe-920f-db8755f9218c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.194877 May 16 18:59:06.518149 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 555/1083] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:06 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:59:07.541381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-12ca80b3-afaf-4e59-9473-e5fdbf532443 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:07.542723 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-12ca80b3-afaf-4e59-9473-e5fdbf532443 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:07.551690 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-12ca80b3-afaf-4e59-9473-e5fdbf532443 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:07.552833 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-12ca80b3-afaf-4e59-9473-e5fdbf532443 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:07.553623 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-12ca80b3-afaf-4e59-9473-e5fdbf532443 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:07.554068 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-12ca80b3-afaf-4e59-9473-e5fdbf532443 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:07.728253 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-12ca80b3-afaf-4e59-9473-e5fdbf532443 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:07.741229 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-12ca80b3-afaf-4e59-9473-e5fdbf532443 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.207234 May 16 18:59:07.745195 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 556/1084] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:07 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:59:08.760912 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-682c31f7-124d-47fb-974f-fae177635fd1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:08.762197 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-682c31f7-124d-47fb-974f-fae177635fd1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:08.770381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-682c31f7-124d-47fb-974f-fae177635fd1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:08.771514 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-682c31f7-124d-47fb-974f-fae177635fd1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:08.772193 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-682c31f7-124d-47fb-974f-fae177635fd1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:08.772745 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-682c31f7-124d-47fb-974f-fae177635fd1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:08.983724 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-682c31f7-124d-47fb-974f-fae177635fd1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:08.998887 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-682c31f7-124d-47fb-974f-fae177635fd1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.242536 May 16 18:59:09.000067 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 557/1085] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:08 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:59:10.020173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5d01adf3-630a-4011-83c4-96b20f9760ad tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:10.021292 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5d01adf3-630a-4011-83c4-96b20f9760ad tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:10.032589 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d01adf3-630a-4011-83c4-96b20f9760ad tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:10.033094 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d01adf3-630a-4011-83c4-96b20f9760ad tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:10.034024 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d01adf3-630a-4011-83c4-96b20f9760ad tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:10.034539 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5d01adf3-630a-4011-83c4-96b20f9760ad tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:10.218951 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5d01adf3-630a-4011-83c4-96b20f9760ad tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:10.232604 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5d01adf3-630a-4011-83c4-96b20f9760ad tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.216787 May 16 18:59:10.234214 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 558/1086] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:10 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:59:11.251145 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-a6617455-265f-4306-aa00-1e4c41e7944f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:11.251947 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-a6617455-265f-4306-aa00-1e4c41e7944f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:11.258381 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6617455-265f-4306-aa00-1e4c41e7944f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:11.258821 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6617455-265f-4306-aa00-1e4c41e7944f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:11.259587 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6617455-265f-4306-aa00-1e4c41e7944f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:11.260057 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-a6617455-265f-4306-aa00-1e4c41e7944f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:11.401584 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-a6617455-265f-4306-aa00-1e4c41e7944f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:11.409158 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-a6617455-265f-4306-aa00-1e4c41e7944f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.162139 May 16 18:59:11.409728 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 559/1087] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:11 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:59:12.049689 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-05acf20f-c4f5-4edb-adc5-522332f330e5 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "POST /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.350958 May 16 18:59:12.050606 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 529/1088] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:59:02 2022] POST /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92/os-volume_attachments => generated 194 bytes in 9353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:59:12.430652 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-561868af-fda8-40f8-b3b0-41242ab41cb4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:12.431347 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-561868af-fda8-40f8-b3b0-41242ab41cb4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:12.438138 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-561868af-fda8-40f8-b3b0-41242ab41cb4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:12.438596 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-561868af-fda8-40f8-b3b0-41242ab41cb4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:12.439397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-561868af-fda8-40f8-b3b0-41242ab41cb4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:12.439856 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-561868af-fda8-40f8-b3b0-41242ab41cb4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:12.650291 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-561868af-fda8-40f8-b3b0-41242ab41cb4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:12.665574 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-561868af-fda8-40f8-b3b0-41242ab41cb4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.238809 May 16 18:59:12.666460 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 560/1089] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:12 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:12.705968 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-2f8971ac-33d6-4858-93b2-fc08ccf1e40e req-2fefbd76-c3bf-4181-9014-36de090da841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03f3b05-1fdd-452d-b3d1-a15c908c83e8", "tag": "76aa757e-a54c-46e1-807c-5b28a26b7b88"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:59:12.721006 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-2f8971ac-33d6-4858-93b2-fc08ccf1e40e req-2fefbd76-c3bf-4181-9014-36de090da841 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:12.721773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-2f8971ac-33d6-4858-93b2-fc08ccf1e40e req-2fefbd76-c3bf-4181-9014-36de090da841 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:12.734927 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-2f8971ac-33d6-4858-93b2-fc08ccf1e40e req-2fefbd76-c3bf-4181-9014-36de090da841 service nova] Creating event network-changed:76aa757e-a54c-46e1-807c-5b28a26b7b88 for instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 on hv-cinder-75078 May 16 18:59:12.740973 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-2f8971ac-33d6-4858-93b2-fc08ccf1e40e req-2fefbd76-c3bf-4181-9014-36de090da841 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042095 May 16 18:59:12.742589 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 530/1090] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:59:13.691155 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-74905349-5fbc-49f4-a031-53afdff7ae7c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:13.691970 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-74905349-5fbc-49f4-a031-53afdff7ae7c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:13.698251 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-74905349-5fbc-49f4-a031-53afdff7ae7c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:13.698703 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-74905349-5fbc-49f4-a031-53afdff7ae7c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:13.699466 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-74905349-5fbc-49f4-a031-53afdff7ae7c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:13.699957 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-74905349-5fbc-49f4-a031-53afdff7ae7c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:13.837685 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-74905349-5fbc-49f4-a031-53afdff7ae7c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:13.846267 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-74905349-5fbc-49f4-a031-53afdff7ae7c tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.158957 May 16 18:59:13.846842 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 561/1091] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:13 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:14.864888 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-9769c0e9-58f8-4f5f-9c66-971c1dfeeee1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:14.865492 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-9769c0e9-58f8-4f5f-9c66-971c1dfeeee1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:14.871592 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9769c0e9-58f8-4f5f-9c66-971c1dfeeee1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:14.872066 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9769c0e9-58f8-4f5f-9c66-971c1dfeeee1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:14.873398 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9769c0e9-58f8-4f5f-9c66-971c1dfeeee1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:14.873835 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-9769c0e9-58f8-4f5f-9c66-971c1dfeeee1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:15.008695 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-9769c0e9-58f8-4f5f-9c66-971c1dfeeee1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:15.016040 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-9769c0e9-58f8-4f5f-9c66-971c1dfeeee1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.155864 May 16 18:59:15.016593 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 531/1092] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:14 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:16.035007 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1d89b50e-58f4-4161-9962-a828715763c1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:16.035654 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1d89b50e-58f4-4161-9962-a828715763c1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:16.042226 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1d89b50e-58f4-4161-9962-a828715763c1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:16.042711 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1d89b50e-58f4-4161-9962-a828715763c1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:16.043482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1d89b50e-58f4-4161-9962-a828715763c1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:16.043948 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1d89b50e-58f4-4161-9962-a828715763c1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:16.180750 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1d89b50e-58f4-4161-9962-a828715763c1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:16.189242 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1d89b50e-58f4-4161-9962-a828715763c1 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.160657 May 16 18:59:16.189824 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 562/1093] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:16 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:17.206230 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-c76dc772-097e-46f5-b384-bdfeb8f43263 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:17.206780 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-c76dc772-097e-46f5-b384-bdfeb8f43263 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:17.213200 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c76dc772-097e-46f5-b384-bdfeb8f43263 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:17.213657 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c76dc772-097e-46f5-b384-bdfeb8f43263 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:17.214425 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c76dc772-097e-46f5-b384-bdfeb8f43263 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:17.215115 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-c76dc772-097e-46f5-b384-bdfeb8f43263 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:17.347859 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-c76dc772-097e-46f5-b384-bdfeb8f43263 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:17.355257 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-c76dc772-097e-46f5-b384-bdfeb8f43263 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.153023 May 16 18:59:17.355886 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 532/1094] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:17 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:17.527257 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-8e0bbc64-030b-4ef8-b7f8-af1c622167f7 req-cbc454cd-edcc-4baf-89a7-a91e8c1555bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03f3b05-1fdd-452d-b3d1-a15c908c83e8", "name": "network-vif-plugged", "status": "completed", "tag": "76aa757e-a54c-46e1-807c-5b28a26b7b88"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:59:17.537902 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-8e0bbc64-030b-4ef8-b7f8-af1c622167f7 req-cbc454cd-edcc-4baf-89a7-a91e8c1555bd service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:17.538720 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-8e0bbc64-030b-4ef8-b7f8-af1c622167f7 req-cbc454cd-edcc-4baf-89a7-a91e8c1555bd service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:17.556330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-8e0bbc64-030b-4ef8-b7f8-af1c622167f7 req-cbc454cd-edcc-4baf-89a7-a91e8c1555bd service nova] Creating event network-vif-plugged:76aa757e-a54c-46e1-807c-5b28a26b7b88 for instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 on hv-cinder-75078 May 16 18:59:17.561775 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-8e0bbc64-030b-4ef8-b7f8-af1c622167f7 req-cbc454cd-edcc-4baf-89a7-a91e8c1555bd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038151 May 16 18:59:17.562442 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 563/1095] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:59:18.373681 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-52561cc6-3313-45b1-8bd0-31f3293df52d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:18.374354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-52561cc6-3313-45b1-8bd0-31f3293df52d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:18.380608 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-52561cc6-3313-45b1-8bd0-31f3293df52d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:18.381053 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-52561cc6-3313-45b1-8bd0-31f3293df52d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:18.381810 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-52561cc6-3313-45b1-8bd0-31f3293df52d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:18.382240 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-52561cc6-3313-45b1-8bd0-31f3293df52d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:18.527641 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-52561cc6-3313-45b1-8bd0-31f3293df52d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:18.535237 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-52561cc6-3313-45b1-8bd0-31f3293df52d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.165886 May 16 18:59:18.535830 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 533/1096] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:18 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:19.559482 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c1245a01-8df7-4c70-8704-a5a34dc70ca9 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:19.560800 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c1245a01-8df7-4c70-8704-a5a34dc70ca9 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:19.570125 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c1245a01-8df7-4c70-8704-a5a34dc70ca9 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:19.570924 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c1245a01-8df7-4c70-8704-a5a34dc70ca9 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:19.572642 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c1245a01-8df7-4c70-8704-a5a34dc70ca9 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:19.573417 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c1245a01-8df7-4c70-8704-a5a34dc70ca9 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:19.729219 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c1245a01-8df7-4c70-8704-a5a34dc70ca9 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:19.741034 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c1245a01-8df7-4c70-8704-a5a34dc70ca9 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1358 microversion: 2.1 time: 0.186254 May 16 18:59:19.741625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 564/1097] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:19 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:20.759401 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f170b65a-b03b-4cc7-8e6f-577ee6e12288 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:20.760796 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f170b65a-b03b-4cc7-8e6f-577ee6e12288 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:20.768097 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f170b65a-b03b-4cc7-8e6f-577ee6e12288 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:20.768551 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f170b65a-b03b-4cc7-8e6f-577ee6e12288 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:20.769330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f170b65a-b03b-4cc7-8e6f-577ee6e12288 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:20.769769 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f170b65a-b03b-4cc7-8e6f-577ee6e12288 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:20.901355 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-f170b65a-b03b-4cc7-8e6f-577ee6e12288 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:20.909853 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f170b65a-b03b-4cc7-8e6f-577ee6e12288 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1547 microversion: 2.1 time: 0.154309 May 16 18:59:20.910432 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 534/1098] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:20 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:20.926075 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7e424da1-cc68-45a7-8e74-52df2b23efb3 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:20.926949 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7e424da1-cc68-45a7-8e74-52df2b23efb3 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:20.933275 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7e424da1-cc68-45a7-8e74-52df2b23efb3 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:20.933726 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7e424da1-cc68-45a7-8e74-52df2b23efb3 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:20.934615 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7e424da1-cc68-45a7-8e74-52df2b23efb3 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:20.934927 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7e424da1-cc68-45a7-8e74-52df2b23efb3 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:21.067317 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7e424da1-cc68-45a7-8e74-52df2b23efb3 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:21.077515 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7e424da1-cc68-45a7-8e74-52df2b23efb3 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1547 microversion: 2.1 time: 0.155188 May 16 18:59:21.078319 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 565/1099] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:20 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:21.093906 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-2333a776-9127-4de4-80f6-49455e125c82 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:21.097348 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-2333a776-9127-4de4-80f6-49455e125c82 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:21.098158 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-2333a776-9127-4de4-80f6-49455e125c82 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Searching by: {'deleted': False, 'project_id': 'bb467769134a4df0bb4608a8283e8dda'} {{(pid=128887) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 16 18:59:21.105023 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2333a776-9127-4de4-80f6-49455e125c82 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:21.105474 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2333a776-9127-4de4-80f6-49455e125c82 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:21.106277 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2333a776-9127-4de4-80f6-49455e125c82 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:21.106750 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-2333a776-9127-4de4-80f6-49455e125c82 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:21.202950 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.multi_cell_list [None req-2333a776-9127-4de4-80f6-49455e125c82 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 16 18:59:21.299526 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-2333a776-9127-4de4-80f6-49455e125c82 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209564 May 16 18:59:21.300149 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 535/1100] 10.222.0.72 () {58 vars in 1124 bytes} [Mon May 16 18:59:21 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:59:21.311054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-88ff3f8c-be7a-4082-91aa-331865e90541 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:21.311669 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-88ff3f8c-be7a-4082-91aa-331865e90541 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:21.317784 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-88ff3f8c-be7a-4082-91aa-331865e90541 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:21.318233 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-88ff3f8c-be7a-4082-91aa-331865e90541 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:21.319008 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-88ff3f8c-be7a-4082-91aa-331865e90541 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:21.319448 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-88ff3f8c-be7a-4082-91aa-331865e90541 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:21.450962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-88ff3f8c-be7a-4082-91aa-331865e90541 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:21.458562 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-88ff3f8c-be7a-4082-91aa-331865e90541 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1547 microversion: 2.1 time: 0.151805 May 16 18:59:21.459146 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 566/1101] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:21 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:24.036523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a0f12089-17f9-4e9e-a633-9aeda6663f43 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c980e45b-1481-48cd-a646-20bfe3b51d5d"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:59:24.037640 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a0f12089-17f9-4e9e-a633-9aeda6663f43 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:24.044288 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0f12089-17f9-4e9e-a633-9aeda6663f43 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:24.045244 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0f12089-17f9-4e9e-a633-9aeda6663f43 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:24.046180 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0f12089-17f9-4e9e-a633-9aeda6663f43 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:24.046629 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a0f12089-17f9-4e9e-a633-9aeda6663f43 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:24.308750 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a0f12089-17f9-4e9e-a633-9aeda6663f43 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "POST /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276121 May 16 18:59:24.309381 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 536/1102] 10.222.0.72 () {60 vars in 1322 bytes} [Mon May 16 18:59:24 2022] POST /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:59:31.582739 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-cd681b87-3fd4-4a48-b54c-21606a60ea99 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:31.583383 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-cd681b87-3fd4-4a48-b54c-21606a60ea99 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:31.590557 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cd681b87-3fd4-4a48-b54c-21606a60ea99 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:31.591265 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cd681b87-3fd4-4a48-b54c-21606a60ea99 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:31.592580 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cd681b87-3fd4-4a48-b54c-21606a60ea99 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:31.593024 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-cd681b87-3fd4-4a48-b54c-21606a60ea99 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:31.678556 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-cd681b87-3fd4-4a48-b54c-21606a60ea99 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lazy-loading 'services' on Instance uuid 481cae72-0842-4a6c-923a-f53aa1653c92 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:59:31.761962 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-cd681b87-3fd4-4a48-b54c-21606a60ea99 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "DELETE /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92/os-volume_attachments/51bc3de1-a3e4-48f7-90bf-8cd30b4651b4" status: 202 len: 0 microversion: 2.1 time: 0.186431 May 16 18:59:31.764437 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 567/1103] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 18:59:31 2022] DELETE /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92/os-volume_attachments/51bc3de1-a3e4-48f7-90bf-8cd30b4651b4 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 18:59:34.089628 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0d62e41d-dd5b-4655-bbf5-a04f2b27765e tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:34.091152 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0d62e41d-dd5b-4655-bbf5-a04f2b27765e tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:34.105562 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d62e41d-dd5b-4655-bbf5-a04f2b27765e tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:34.106101 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d62e41d-dd5b-4655-bbf5-a04f2b27765e tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:34.107517 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d62e41d-dd5b-4655-bbf5-a04f2b27765e tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:34.107988 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0d62e41d-dd5b-4655-bbf5-a04f2b27765e tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:34.269013 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0d62e41d-dd5b-4655-bbf5-a04f2b27765e tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:34.277721 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0d62e41d-dd5b-4655-bbf5-a04f2b27765e tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1593 microversion: 2.1 time: 0.192960 May 16 18:59:34.279067 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 537/1104] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:34 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1593 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:35.069730 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-e1dbc748-038a-4faf-bd79-29b931fd3732 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:35.070388 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-e1dbc748-038a-4faf-bd79-29b931fd3732 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:35.077163 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e1dbc748-038a-4faf-bd79-29b931fd3732 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:35.077625 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e1dbc748-038a-4faf-bd79-29b931fd3732 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:35.078424 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e1dbc748-038a-4faf-bd79-29b931fd3732 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:35.078869 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-e1dbc748-038a-4faf-bd79-29b931fd3732 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:35.115416 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-e1dbc748-038a-4faf-bd79-29b931fd3732 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Going to try to terminate instance {{(pid=128886) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:59:35.217940 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-e1dbc748-038a-4faf-bd79-29b931fd3732 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "DELETE /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 204 len: 0 microversion: 2.1 time: 0.152551 May 16 18:59:35.218978 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 568/1105] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:59:35 2022] DELETE /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 18:59:35.231810 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-797cc92f-cc83-4da1-8ec5-ff8b5a96cfd3 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:35.231810 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-797cc92f-cc83-4da1-8ec5-ff8b5a96cfd3 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:35.238110 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-797cc92f-cc83-4da1-8ec5-ff8b5a96cfd3 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:35.238911 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-797cc92f-cc83-4da1-8ec5-ff8b5a96cfd3 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:35.240436 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-797cc92f-cc83-4da1-8ec5-ff8b5a96cfd3 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:35.241236 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-797cc92f-cc83-4da1-8ec5-ff8b5a96cfd3 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:35.508863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-797cc92f-cc83-4da1-8ec5-ff8b5a96cfd3 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:35.520121 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-797cc92f-cc83-4da1-8ec5-ff8b5a96cfd3 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1513 microversion: 2.1 time: 0.295837 May 16 18:59:35.520705 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 538/1106] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:35 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:36.544232 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-62d4ea0d-4795-4ce9-b275-06885a302a7b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:36.545215 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-62d4ea0d-4795-4ce9-b275-06885a302a7b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:36.553078 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-62d4ea0d-4795-4ce9-b275-06885a302a7b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:36.553777 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-62d4ea0d-4795-4ce9-b275-06885a302a7b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:36.554901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-62d4ea0d-4795-4ce9-b275-06885a302a7b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:36.555390 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-62d4ea0d-4795-4ce9-b275-06885a302a7b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:36.761158 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-62d4ea0d-4795-4ce9-b275-06885a302a7b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:36.771280 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-62d4ea0d-4795-4ce9-b275-06885a302a7b tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1513 microversion: 2.1 time: 0.234074 May 16 18:59:36.773026 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 569/1107] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:36 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:36.799048 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-423b260b-3095-4159-a336-5f8baf54ee6c req-1932849a-4b51-4bc5-ac75-e2d58b09be54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03f3b05-1fdd-452d-b3d1-a15c908c83e8", "tag": "76aa757e-a54c-46e1-807c-5b28a26b7b88"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:59:36.809125 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-423b260b-3095-4159-a336-5f8baf54ee6c req-1932849a-4b51-4bc5-ac75-e2d58b09be54 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:36.810272 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-423b260b-3095-4159-a336-5f8baf54ee6c req-1932849a-4b51-4bc5-ac75-e2d58b09be54 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:36.824821 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-423b260b-3095-4159-a336-5f8baf54ee6c req-1932849a-4b51-4bc5-ac75-e2d58b09be54 service nova] Creating event network-changed:76aa757e-a54c-46e1-807c-5b28a26b7b88 for instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 on hv-cinder-75078 May 16 18:59:36.831665 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-423b260b-3095-4159-a336-5f8baf54ee6c req-1932849a-4b51-4bc5-ac75-e2d58b09be54 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153335 May 16 18:59:36.833056 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 539/1108] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:59:37.791048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6adce5c7-5469-4eae-be67-b615d662451e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:37.797387 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6adce5c7-5469-4eae-be67-b615d662451e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:37.807624 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6adce5c7-5469-4eae-be67-b615d662451e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:37.808263 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6adce5c7-5469-4eae-be67-b615d662451e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:37.809858 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6adce5c7-5469-4eae-be67-b615d662451e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:37.810991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6adce5c7-5469-4eae-be67-b615d662451e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:38.146991 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6adce5c7-5469-4eae-be67-b615d662451e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:38.158930 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6adce5c7-5469-4eae-be67-b615d662451e tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1513 microversion: 2.1 time: 0.371928 May 16 18:59:38.159904 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 570/1109] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:37 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1513 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:38.205363 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-445f4d3a-7b9c-45f9-9134-0d1e64266278 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1100682165"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:59:38.206025 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-445f4d3a-7b9c-45f9-9134-0d1e64266278 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:38.218980 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-445f4d3a-7b9c-45f9-9134-0d1e64266278 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:38.219466 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-445f4d3a-7b9c-45f9-9134-0d1e64266278 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:38.220276 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-445f4d3a-7b9c-45f9-9134-0d1e64266278 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:38.220711 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-445f4d3a-7b9c-45f9-9134-0d1e64266278 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:38.500168 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.network.security_group_api [None req-445f4d3a-7b9c-45f9-9134-0d1e64266278 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Adding security group 30bba3fa-194d-4b6b-ad9d-057a797e6354 to port 76aa757e-a54c-46e1-807c-5b28a26b7b88 May 16 18:59:38.854609 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-eedec648-c144-4a53-8fcc-8307399a1a2e req-8c60deda-e348-4c7a-82a2-21faf266b3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "481cae72-0842-4a6c-923a-f53aa1653c92", "name": "network-vif-deleted", "tag": "3aa20307-2122-4b8c-bcdb-38e24f4e8abc"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:59:38.870373 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-eedec648-c144-4a53-8fcc-8307399a1a2e req-8c60deda-e348-4c7a-82a2-21faf266b3be service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:38.871103 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-eedec648-c144-4a53-8fcc-8307399a1a2e req-8c60deda-e348-4c7a-82a2-21faf266b3be service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:38.885563 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-eedec648-c144-4a53-8fcc-8307399a1a2e req-8c60deda-e348-4c7a-82a2-21faf266b3be service nova] Creating event network-vif-deleted:3aa20307-2122-4b8c-bcdb-38e24f4e8abc for instance 481cae72-0842-4a6c-923a-f53aa1653c92 on hv-cinder-75078 May 16 18:59:38.890923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-eedec648-c144-4a53-8fcc-8307399a1a2e req-8c60deda-e348-4c7a-82a2-21faf266b3be service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039987 May 16 18:59:38.891631 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 571/1110] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:59:39.082619 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-445f4d3a-7b9c-45f9-9134-0d1e64266278 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "POST /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/action" status: 202 len: 0 microversion: 2.1 time: 0.882397 May 16 18:59:39.084874 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 540/1111] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 18:59:38 2022] POST /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/action => generated 0 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 18:59:39.095903 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-19dbca01-df42-42ce-aa74-f7c34809ad28 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:39.096627 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-19dbca01-df42-42ce-aa74-f7c34809ad28 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:39.103054 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-19dbca01-df42-42ce-aa74-f7c34809ad28 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:39.103916 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-19dbca01-df42-42ce-aa74-f7c34809ad28 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:39.104901 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-19dbca01-df42-42ce-aa74-f7c34809ad28 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:39.105377 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-19dbca01-df42-42ce-aa74-f7c34809ad28 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:39.189389 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:39.190532 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:39.205041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:39.206268 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:39.208185 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:39.209083 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:39.253571 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:39.254271 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:39.254909 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.objects.instance [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lazy-loading 'fault' on Instance uuid 481cae72-0842-4a6c-923a-f53aa1653c92 {{(pid=128887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 18:59:39.360677 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb61d5251e74d529a6bfa7d3a684123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf09aab60304f30ae52a87b7b1ea81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:39.374699 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1aad96d1-c376-48a2-a001-4b6ee34001a4 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 200 len: 1308 microversion: 2.1 time: 0.194657 May 16 18:59:39.375773 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 541/1112] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:39 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 1308 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 18:59:39.408968 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-19dbca01-df42-42ce-aa74-f7c34809ad28 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:39.420254 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-19dbca01-df42-42ce-aa74-f7c34809ad28 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1759 microversion: 2.1 time: 0.328497 May 16 18:59:39.420852 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 572/1113] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:39 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1759 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:40.392093 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-08a34469-f98c-40fc-b3e3-effadafa9cf8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:40.392724 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-08a34469-f98c-40fc-b3e3-effadafa9cf8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] [instance: 481cae72-0842-4a6c-923a-f53aa1653c92] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:40.399162 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-08a34469-f98c-40fc-b3e3-effadafa9cf8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:40.399610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-08a34469-f98c-40fc-b3e3-effadafa9cf8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:40.400408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-08a34469-f98c-40fc-b3e3-effadafa9cf8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:40.400842 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-08a34469-f98c-40fc-b3e3-effadafa9cf8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:40.414634 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-08a34469-f98c-40fc-b3e3-effadafa9cf8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] HTTP exception thrown: Instance 481cae72-0842-4a6c-923a-f53aa1653c92 could not be found. May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-08a34469-f98c-40fc-b3e3-effadafa9cf8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Request method failure captured: May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 HTTP/1.1 May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigp6PNBpOSZfdpGmjQldkri1czAaM71Yxh9m5bb0HvuPue-k4SKPrA-Vedx0aR5L_k-syXUNe5E4IL6-37BrbDE1kT_6X_O2dnH1cdU_5dBqbNxBVe93GdKcmtrr3905DdwJSuw5wYLs3lM8y9xEqD9B8XH6-1J7lUeNhQXD2s4bbNWo May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 9cf09aab60304f30ae52a87b7b1ea81a May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-VolumesSnapshotTestJSON-448911475 May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:59:40.416330 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9cf09aab60304f30ae52a87b7b1ea81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cf09aab60304f30ae52a87b7b1ea81a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cf09aab60304f30ae52a87b7b1ea81a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9cf09aab60304f30ae52a87b7b1ea81a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-VolumesSnapshotTestJSON-448911475 May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 9cf09aab60304f30ae52a87b7b1ea81a May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-448911475 May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-VolumesSnapshotTestJSON-448911475-project May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 9cb61d5251e74d529a6bfa7d3a684123 May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-VolumesSnapshotTestJSON-448911475-project May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 481cae72-0842-4a6c-923a-f53aa1653c92 could not be found. May 16 18:59:40.418301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '481cae72-0842-4a6c-923a-f53aa1653c92'} May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 481cae72-0842-4a6c-923a-f53aa1653c92 could not be found. May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:59:40.419928 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 481cae72-0842-4a6c-923a-f53aa1653c92 could not be found. May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 481cae72-0842-4a6c-923a-f53aa1653c92 could not be found. May 16 18:59:40.421914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:59:40.423189 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-08a34469-f98c-40fc-b3e3-effadafa9cf8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] Returning 404 to user: Instance 481cae72-0842-4a6c-923a-f53aa1653c92 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:59:40.423189 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-08a34469-f98c-40fc-b3e3-effadafa9cf8 tempest-VolumesSnapshotTestJSON-448911475 tempest-VolumesSnapshotTestJSON-448911475-project] 10.222.0.72 "GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92" status: 404 len: 111 microversion: 2.1 time: 0.029785 May 16 18:59:40.423189 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 542/1114] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:40 2022] GET /compute/v2.1/servers/481cae72-0842-4a6c-923a-f53aa1653c92 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 18:59:40.905825 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-60741dbc-accb-4f7f-a410-76730386439e req-027013bf-8f92-403c-b92d-615108e32b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03f3b05-1fdd-452d-b3d1-a15c908c83e8", "tag": "76aa757e-a54c-46e1-807c-5b28a26b7b88"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:59:40.917515 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-60741dbc-accb-4f7f-a410-76730386439e req-027013bf-8f92-403c-b92d-615108e32b56 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:40.917957 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-60741dbc-accb-4f7f-a410-76730386439e req-027013bf-8f92-403c-b92d-615108e32b56 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:40.929684 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-60741dbc-accb-4f7f-a410-76730386439e req-027013bf-8f92-403c-b92d-615108e32b56 service nova] Creating event network-changed:76aa757e-a54c-46e1-807c-5b28a26b7b88 for instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 on hv-cinder-75078 May 16 18:59:40.935084 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-60741dbc-accb-4f7f-a410-76730386439e req-027013bf-8f92-403c-b92d-615108e32b56 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033416 May 16 18:59:40.935692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 573/1115] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 18:59:54.111531 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-f89eb092-8dad-4027-8f79-24353b86561b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:54.112311 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f89eb092-8dad-4027-8f79-24353b86561b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:54.120527 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f89eb092-8dad-4027-8f79-24353b86561b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:54.120984 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f89eb092-8dad-4027-8f79-24353b86561b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:54.121827 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f89eb092-8dad-4027-8f79-24353b86561b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:54.122257 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-f89eb092-8dad-4027-8f79-24353b86561b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:54.149851 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-f89eb092-8dad-4027-8f79-24353b86561b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Going to try to terminate instance {{(pid=128887) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 18:59:54.185175 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-6edea02c-ba40-413a-b331-c64470eb6c6a req-d333445a-bb89-4e31-bf73-1791fe2c957b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97a9c223-ae61-46b2-b25b-e996c79938c2", "tag": "f3724a00-7e9f-4041-8edf-d95832fa4fc7"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:59:54.193844 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-6edea02c-ba40-413a-b331-c64470eb6c6a req-d333445a-bb89-4e31-bf73-1791fe2c957b service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:54.194241 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-6edea02c-ba40-413a-b331-c64470eb6c6a req-d333445a-bb89-4e31-bf73-1791fe2c957b service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:54.209582 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-6edea02c-ba40-413a-b331-c64470eb6c6a req-d333445a-bb89-4e31-bf73-1791fe2c957b service nova] Creating event network-changed:f3724a00-7e9f-4041-8edf-d95832fa4fc7 for instance 97a9c223-ae61-46b2-b25b-e996c79938c2 on hv-cinder-75078 May 16 18:59:54.215744 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-6edea02c-ba40-413a-b331-c64470eb6c6a req-d333445a-bb89-4e31-bf73-1791fe2c957b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104248 May 16 18:59:54.216380 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 574/1116] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:59:54.268463 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-f89eb092-8dad-4027-8f79-24353b86561b tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "DELETE /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 204 len: 0 microversion: 2.1 time: 0.159809 May 16 18:59:54.282342 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 543/1117] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 18:59:54 2022] DELETE /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 18:59:54.282655 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-5885128f-64fa-4af4-942d-53ade3ed092d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:54.283598 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-5885128f-64fa-4af4-942d-53ade3ed092d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:54.290958 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5885128f-64fa-4af4-942d-53ade3ed092d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:54.291465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5885128f-64fa-4af4-942d-53ade3ed092d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:54.292296 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5885128f-64fa-4af4-942d-53ade3ed092d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:54.292733 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-5885128f-64fa-4af4-942d-53ade3ed092d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:54.476692 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-5885128f-64fa-4af4-942d-53ade3ed092d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:54.485516 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-5885128f-64fa-4af4-942d-53ade3ed092d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1577 microversion: 2.1 time: 0.210666 May 16 18:59:54.486313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 575/1118] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:54 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:55.506892 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-5c3a8f31-1a7b-4fe6-a5c4-cbb3bf3b6afd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:55.507596 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-5c3a8f31-1a7b-4fe6-a5c4-cbb3bf3b6afd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:55.515354 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5c3a8f31-1a7b-4fe6-a5c4-cbb3bf3b6afd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:55.515840 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5c3a8f31-1a7b-4fe6-a5c4-cbb3bf3b6afd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:55.516624 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5c3a8f31-1a7b-4fe6-a5c4-cbb3bf3b6afd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:55.517066 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-5c3a8f31-1a7b-4fe6-a5c4-cbb3bf3b6afd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:55.723107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-5c3a8f31-1a7b-4fe6-a5c4-cbb3bf3b6afd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:55.731682 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-5c3a8f31-1a7b-4fe6-a5c4-cbb3bf3b6afd tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1577 microversion: 2.1 time: 0.229843 May 16 18:59:55.732299 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 544/1119] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:55 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:56.749530 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-3141f0d4-e961-4b03-b1b0-eb922b83aaf9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:56.750410 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-3141f0d4-e961-4b03-b1b0-eb922b83aaf9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:56.758284 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3141f0d4-e961-4b03-b1b0-eb922b83aaf9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:56.758786 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3141f0d4-e961-4b03-b1b0-eb922b83aaf9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:56.759644 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3141f0d4-e961-4b03-b1b0-eb922b83aaf9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:56.760359 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-3141f0d4-e961-4b03-b1b0-eb922b83aaf9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:56.765268 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-4396d0bb-3b12-432c-ae1d-6d93aa489166 req-b95088bb-fae1-4ac1-aab2-5341013edca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a9c223-ae61-46b2-b25b-e996c79938c2", "name": "network-vif-deleted", "tag": "f3724a00-7e9f-4041-8edf-d95832fa4fc7"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 18:59:56.779504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-4396d0bb-3b12-432c-ae1d-6d93aa489166 req-b95088bb-fae1-4ac1-aab2-5341013edca6 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:56.779993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-4396d0bb-3b12-432c-ae1d-6d93aa489166 req-b95088bb-fae1-4ac1-aab2-5341013edca6 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:56.793378 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-4396d0bb-3b12-432c-ae1d-6d93aa489166 req-b95088bb-fae1-4ac1-aab2-5341013edca6 service nova] Creating event network-vif-deleted:f3724a00-7e9f-4041-8edf-d95832fa4fc7 for instance 97a9c223-ae61-46b2-b25b-e996c79938c2 on hv-cinder-75078 May 16 18:59:56.802831 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-4396d0bb-3b12-432c-ae1d-6d93aa489166 req-b95088bb-fae1-4ac1-aab2-5341013edca6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043987 May 16 18:59:56.803974 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 545/1120] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 18:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 18:59:56.861609 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-3141f0d4-e961-4b03-b1b0-eb922b83aaf9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 18:59:56.869856 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-3141f0d4-e961-4b03-b1b0-eb922b83aaf9 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 200 len: 1391 microversion: 2.1 time: 0.124596 May 16 18:59:56.870433 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 576/1121] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:56 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 1391 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 18:59:57.890801 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-35ce93ea-c3b4-400c-8af2-361ff296c749 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:57.891517 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-35ce93ea-c3b4-400c-8af2-361ff296c749 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 97a9c223-ae61-46b2-b25b-e996c79938c2] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 18:59:57.898100 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35ce93ea-c3b4-400c-8af2-361ff296c749 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:57.898563 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35ce93ea-c3b4-400c-8af2-361ff296c749 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:57.899390 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35ce93ea-c3b4-400c-8af2-361ff296c749 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:57.899866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-35ce93ea-c3b4-400c-8af2-361ff296c749 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:57.915056 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-35ce93ea-c3b4-400c-8af2-361ff296c749 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] HTTP exception thrown: Instance 97a9c223-ae61-46b2-b25b-e996c79938c2 could not be found. May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-35ce93ea-c3b4-400c-8af2-361ff296c749 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Request method failure captured: May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 HTTP/1.1 May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigp0ctcFRe8IRwshvpn60txg7kjLxd78mw2FNSVbypy6EOg7Tx_r9brAsWIc1PT2wNvbFTnYR-A5aHBqWMV0idIk_aliJtkmHEtvXKnOlBZ0GUzGdffk_HJN_LbaqrXgfYnSNXSmoe9c59uNA9iY9kIMl8wilMwnir8eww3JC06AxNQA May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 5b168bfd42a645269b47c98f4210e4aa May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-TestVolumeBootPattern-325784663 May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 18:59:57.916792 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-TestVolumeBootPattern-325784663 May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 5b168bfd42a645269b47c98f4210e4aa May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-TestVolumeBootPattern-325784663 May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-TestVolumeBootPattern-325784663-project May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 5e9ebfaac4984817bb768476ef74445c May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-TestVolumeBootPattern-325784663-project May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 97a9c223-ae61-46b2-b25b-e996c79938c2 could not be found. May 16 18:59:57.918511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '97a9c223-ae61-46b2-b25b-e996c79938c2'} May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a9c223-ae61-46b2-b25b-e996c79938c2 could not be found. May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 18:59:57.919416 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a9c223-ae61-46b2-b25b-e996c79938c2 could not be found. May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a9c223-ae61-46b2-b25b-e996c79938c2 could not be found. May 16 18:59:57.921032 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 18:59:57.922403 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-35ce93ea-c3b4-400c-8af2-361ff296c749 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Returning 404 to user: Instance 97a9c223-ae61-46b2-b25b-e996c79938c2 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 18:59:57.922403 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-35ce93ea-c3b4-400c-8af2-361ff296c749 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2" status: 404 len: 111 microversion: 2.1 time: 0.033223 May 16 18:59:57.922403 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 546/1122] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 18:59:57 2022] GET /compute/v2.1/servers/97a9c223-ae61-46b2-b25b-e996c79938c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:00:01.113985 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-09b1ba79-9c96-43ea-a319-5aca32036919 req-13983d38-cab5-47b6-b569-971354c74482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e5af044-6215-4872-8d22-7da21c796f5d", "tag": "05c357f9-475e-4afa-b068-1499c20820a7"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:01.115330 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6fb66661-fb4c-4436-8c38-14e73944ad88 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:01.116213 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6fb66661-fb4c-4436-8c38-14e73944ad88 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:01.123586 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-09b1ba79-9c96-43ea-a319-5aca32036919 req-13983d38-cab5-47b6-b569-971354c74482 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:01.124145 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-09b1ba79-9c96-43ea-a319-5aca32036919 req-13983d38-cab5-47b6-b569-971354c74482 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:01.128073 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6fb66661-fb4c-4436-8c38-14e73944ad88 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:01.129182 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6fb66661-fb4c-4436-8c38-14e73944ad88 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:01.130546 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6fb66661-fb4c-4436-8c38-14e73944ad88 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:01.131823 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6fb66661-fb4c-4436-8c38-14e73944ad88 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:01.136419 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-09b1ba79-9c96-43ea-a319-5aca32036919 req-13983d38-cab5-47b6-b569-971354c74482 service nova] Creating event network-changed:05c357f9-475e-4afa-b068-1499c20820a7 for instance 9e5af044-6215-4872-8d22-7da21c796f5d on hv-cinder-75078 May 16 19:00:01.144353 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-09b1ba79-9c96-43ea-a319-5aca32036919 req-13983d38-cab5-47b6-b569-971354c74482 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034230 May 16 19:00:01.145326 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 547/1123] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 19:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:00:01.165338 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6fb66661-fb4c-4436-8c38-14e73944ad88 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Going to try to terminate instance {{(pid=128886) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:00:01.286936 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6fb66661-fb4c-4436-8c38-14e73944ad88 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 204 len: 0 microversion: 2.1 time: 0.177893 May 16 19:00:01.288577 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 577/1124] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 19:00:01 2022] DELETE /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:00:01.299029 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-df01b63a-b965-4064-a414-a2b000567323 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:01.300112 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-df01b63a-b965-4064-a414-a2b000567323 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:01.307227 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-df01b63a-b965-4064-a414-a2b000567323 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:01.308031 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-df01b63a-b965-4064-a414-a2b000567323 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:01.310179 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-df01b63a-b965-4064-a414-a2b000567323 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:01.310908 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-df01b63a-b965-4064-a414-a2b000567323 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:01.495550 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-df01b63a-b965-4064-a414-a2b000567323 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:01.504991 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-df01b63a-b965-4064-a414-a2b000567323 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1576 microversion: 2.1 time: 0.211531 May 16 19:00:01.505729 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 548/1125] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:01 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:00:02.525463 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f87277fe-7cc1-4f8e-b86f-8d8302447b86 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:02.526651 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f87277fe-7cc1-4f8e-b86f-8d8302447b86 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:02.538273 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f87277fe-7cc1-4f8e-b86f-8d8302447b86 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:02.538790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f87277fe-7cc1-4f8e-b86f-8d8302447b86 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:02.539594 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f87277fe-7cc1-4f8e-b86f-8d8302447b86 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:02.540069 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f87277fe-7cc1-4f8e-b86f-8d8302447b86 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:02.695157 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f87277fe-7cc1-4f8e-b86f-8d8302447b86 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:02.706853 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f87277fe-7cc1-4f8e-b86f-8d8302447b86 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1576 microversion: 2.1 time: 0.186768 May 16 19:00:02.707702 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 578/1126] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:02 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:03.725570 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ad2641b1-47d4-47ae-b24f-94b3df0f956d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:03.726219 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ad2641b1-47d4-47ae-b24f-94b3df0f956d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:03.733214 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad2641b1-47d4-47ae-b24f-94b3df0f956d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:03.733666 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad2641b1-47d4-47ae-b24f-94b3df0f956d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:03.734443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad2641b1-47d4-47ae-b24f-94b3df0f956d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:03.734877 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ad2641b1-47d4-47ae-b24f-94b3df0f956d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:03.955465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [req-e0b6a20d-fe59-4496-8d92-2eb98fc55f90 req-de1e52e7-e579-424a-af8d-9a9da5bb7a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e5af044-6215-4872-8d22-7da21c796f5d", "name": "network-vif-deleted", "tag": "05c357f9-475e-4afa-b068-1499c20820a7"}]} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:03.968508 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ad2641b1-47d4-47ae-b24f-94b3df0f956d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9ebfaac4984817bb768476ef74445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b168bfd42a645269b47c98f4210e4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:03.968778 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-e0b6a20d-fe59-4496-8d92-2eb98fc55f90 req-de1e52e7-e579-424a-af8d-9a9da5bb7a5c service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:03.968778 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [req-e0b6a20d-fe59-4496-8d92-2eb98fc55f90 req-de1e52e7-e579-424a-af8d-9a9da5bb7a5c service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:03.975345 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ad2641b1-47d4-47ae-b24f-94b3df0f956d tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 200 len: 1458 microversion: 2.1 time: 0.253674 May 16 19:00:03.976518 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 549/1127] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:03 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 1458 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:03.987570 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.compute.server_external_events [req-e0b6a20d-fe59-4496-8d92-2eb98fc55f90 req-de1e52e7-e579-424a-af8d-9a9da5bb7a5c service nova] Creating event network-vif-deleted:05c357f9-475e-4afa-b068-1499c20820a7 for instance 9e5af044-6215-4872-8d22-7da21c796f5d on hv-cinder-75078 May 16 19:00:03.992774 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [req-e0b6a20d-fe59-4496-8d92-2eb98fc55f90 req-de1e52e7-e579-424a-af8d-9a9da5bb7a5c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041092 May 16 19:00:03.993423 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 579/1128] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 19:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:00:04.995582 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-92c3b4c0-978c-4fd7-a181-d94d2c413f2a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:04.996813 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-92c3b4c0-978c-4fd7-a181-d94d2c413f2a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: 9e5af044-6215-4872-8d22-7da21c796f5d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:05.003313 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-92c3b4c0-978c-4fd7-a181-d94d2c413f2a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:05.003794 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-92c3b4c0-978c-4fd7-a181-d94d2c413f2a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:05.004575 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-92c3b4c0-978c-4fd7-a181-d94d2c413f2a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:05.005017 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-92c3b4c0-978c-4fd7-a181-d94d2c413f2a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:05.018609 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-92c3b4c0-978c-4fd7-a181-d94d2c413f2a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] HTTP exception thrown: Instance 9e5af044-6215-4872-8d22-7da21c796f5d could not be found. May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-92c3b4c0-978c-4fd7-a181-d94d2c413f2a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Request method failure captured: May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d HTTP/1.1 May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigp0ctcFRe8IRwshvpn60txg7kjLxd78mw2FNSVbypy6EOg7Tx_r9brAsWIc1PT2wNvbFTnYR-A5aHBqWMV0idIk_aliJtkmHEtvXKnOlBZ0GUzGdffk_HJN_LbaqrXgfYnSNXSmoe9c59uNA9iY9kIMl8wilMwnir8eww3JC06AxNQA May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 5b168bfd42a645269b47c98f4210e4aa May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-TestVolumeBootPattern-325784663 May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 19:00:05.020293 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-TestVolumeBootPattern-325784663 May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 5b168bfd42a645269b47c98f4210e4aa May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-TestVolumeBootPattern-325784663 May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-TestVolumeBootPattern-325784663-project May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 5e9ebfaac4984817bb768476ef74445c May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-TestVolumeBootPattern-325784663-project May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance 9e5af044-6215-4872-8d22-7da21c796f5d could not be found. May 16 19:00:05.021952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': '9e5af044-6215-4872-8d22-7da21c796f5d'} May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e5af044-6215-4872-8d22-7da21c796f5d could not be found. May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:00:05.022804 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e5af044-6215-4872-8d22-7da21c796f5d could not be found. May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e5af044-6215-4872-8d22-7da21c796f5d could not be found. May 16 19:00:05.024305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:00:05.025727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-92c3b4c0-978c-4fd7-a181-d94d2c413f2a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Returning 404 to user: Instance 9e5af044-6215-4872-8d22-7da21c796f5d could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:00:05.025727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-92c3b4c0-978c-4fd7-a181-d94d2c413f2a tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d" status: 404 len: 111 microversion: 2.1 time: 0.031622 May 16 19:00:05.025727 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 550/1129] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:04 2022] GET /compute/v2.1/servers/9e5af044-6215-4872-8d22-7da21c796f5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:00:05.491313 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-aa50c927-f37d-4cb2-a4f8-a78153db2e21 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:05.491949 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-aa50c927-f37d-4cb2-a4f8-a78153db2e21 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:05.498806 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa50c927-f37d-4cb2-a4f8-a78153db2e21 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:05.499256 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa50c927-f37d-4cb2-a4f8-a78153db2e21 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:05.500073 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa50c927-f37d-4cb2-a4f8-a78153db2e21 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:05.500516 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-aa50c927-f37d-4cb2-a4f8-a78153db2e21 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:05.514833 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.wsgi [None req-aa50c927-f37d-4cb2-a4f8-a78153db2e21 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] HTTP exception thrown: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-aa50c927-f37d-4cb2-a4f8-a78153db2e21 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Request method failure captured: May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: request: DELETE /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d HTTP/1.1 May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept: application/json May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Accept-Encoding: identity May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Connection: close May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Length: 0 May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Content-Type: application/json May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Host: 10.222.0.72 May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Openstack-System-Scope: None May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: User-Agent: python-urllib3/1.26.9 May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Auth-Token: gAAAAABigp0ctcFRe8IRwshvpn60txg7kjLxd78mw2FNSVbypy6EOg7Tx_r9brAsWIc1PT2wNvbFTnYR-A5aHBqWMV0idIk_aliJtkmHEtvXKnOlBZ0GUzGdffk_HJN_LbaqrXgfYnSNXSmoe9c59uNA9iY9kIMl8wilMwnir8eww3JC06AxNQA May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Id: None May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Domain-Name: None May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Identity-Status: Confirmed May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Is-Admin-Project: True May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Id: default May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Domain-Name: Default May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Id: 5b168bfd42a645269b47c98f4210e4aa May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Project-Name: tempest-TestVolumeBootPattern-325784663 May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Role: reader,member May 16 19:00:05.516660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Roles: reader,member May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant: tempest-TestVolumeBootPattern-325784663 May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Id: 5b168bfd42a645269b47c98f4210e4aa May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-Tenant-Name: tempest-TestVolumeBootPattern-325784663 May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User: tempest-TestVolumeBootPattern-325784663-project May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Id: default May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Domain-Name: Default May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Id: 5e9ebfaac4984817bb768476ef74445c May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: X-User-Name: tempest-TestVolumeBootPattern-325784663-project May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: method: > May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: exception: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 19:00:05.518290 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: action_args: {'id': 'f9f61265-a9db-48ea-a142-5238bf17239d'} May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:00:05.519348 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 19:00:05.520757 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: ERROR nova.api.openstack.wsgi May 16 19:00:05.522248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-aa50c927-f37d-4cb2-a4f8-a78153db2e21 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Returning 404 to user: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. {{(pid=128886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:00:05.522248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-aa50c927-f37d-4cb2-a4f8-a78153db2e21 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 404 len: 111 microversion: 2.1 time: 0.031654 May 16 19:00:05.522248 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 580/1130] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 19:00:05 2022] DELETE /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:00:05.527577 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a5f19248-6805-4bda-8812-d9d39319c097 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:05.528226 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-a5f19248-6805-4bda-8812-d9d39319c097 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] [instance: f9f61265-a9db-48ea-a142-5238bf17239d] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:05.534599 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a5f19248-6805-4bda-8812-d9d39319c097 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:05.535048 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a5f19248-6805-4bda-8812-d9d39319c097 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:05.536125 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a5f19248-6805-4bda-8812-d9d39319c097 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:05.536319 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-a5f19248-6805-4bda-8812-d9d39319c097 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:05.551462 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-a5f19248-6805-4bda-8812-d9d39319c097 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] HTTP exception thrown: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a5f19248-6805-4bda-8812-d9d39319c097 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Request method failure captured: May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d HTTP/1.1 May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigp0ctcFRe8IRwshvpn60txg7kjLxd78mw2FNSVbypy6EOg7Tx_r9brAsWIc1PT2wNvbFTnYR-A5aHBqWMV0idIk_aliJtkmHEtvXKnOlBZ0GUzGdffk_HJN_LbaqrXgfYnSNXSmoe9c59uNA9iY9kIMl8wilMwnir8eww3JC06AxNQA May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: 5b168bfd42a645269b47c98f4210e4aa May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-TestVolumeBootPattern-325784663 May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 19:00:05.554907 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5b168bfd42a645269b47c98f4210e4aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-TestVolumeBootPattern-325784663 May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: 5b168bfd42a645269b47c98f4210e4aa May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-TestVolumeBootPattern-325784663 May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-TestVolumeBootPattern-325784663-project May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 5e9ebfaac4984817bb768476ef74445c May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-TestVolumeBootPattern-325784663-project May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 19:00:05.556610 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': 'f9f61265-a9db-48ea-a142-5238bf17239d'} May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:00:05.557523 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. May 16 19:00:05.559633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:00:05.561095 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-a5f19248-6805-4bda-8812-d9d39319c097 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Returning 404 to user: Instance f9f61265-a9db-48ea-a142-5238bf17239d could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:00:05.561095 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-a5f19248-6805-4bda-8812-d9d39319c097 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d" status: 404 len: 111 microversion: 2.1 time: 0.032950 May 16 19:00:05.562779 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 551/1131] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:05 2022] GET /compute/v2.1/servers/f9f61265-a9db-48ea-a142-5238bf17239d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:00:06.881850 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-02166e63-8b58-4430-93a2-b00c57e83c54 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] Calling method '.version_select at 0x7f646ce92c10>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:06.903576 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-02166e63-8b58-4430-93a2-b00c57e83c54 tempest-TestVolumeBootPattern-325784663 tempest-TestVolumeBootPattern-325784663-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-426666422" status: 202 len: 0 microversion: 2.1 time: 0.025069 May 16 19:00:06.904210 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 581/1132] 10.222.0.72 () {58 vars in 1259 bytes} [Mon May 16 19:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-426666422 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:00:11.331392 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-691c8bde-22dd-4c79-8f28-3b82412e6abf tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:11.332595 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-691c8bde-22dd-4c79-8f28-3b82412e6abf tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:11.341947 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-691c8bde-22dd-4c79-8f28-3b82412e6abf tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:11.343241 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-691c8bde-22dd-4c79-8f28-3b82412e6abf tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:11.344331 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-691c8bde-22dd-4c79-8f28-3b82412e6abf tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:11.344944 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-691c8bde-22dd-4c79-8f28-3b82412e6abf tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:11.442504 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-691c8bde-22dd-4c79-8f28-3b82412e6abf tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "POST /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/action" status: 202 len: 0 microversion: 2.1 time: 0.115084 May 16 19:00:11.443747 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 552/1133] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 19:00:11 2022] POST /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:00:11.454387 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ab370581-389e-4c1f-b879-fbcbd9edc2a0 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:11.457216 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ab370581-389e-4c1f-b879-fbcbd9edc2a0 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:11.465580 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ab370581-389e-4c1f-b879-fbcbd9edc2a0 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:11.466216 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ab370581-389e-4c1f-b879-fbcbd9edc2a0 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:11.467092 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ab370581-389e-4c1f-b879-fbcbd9edc2a0 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:11.467539 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ab370581-389e-4c1f-b879-fbcbd9edc2a0 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:11.773519 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ab370581-389e-4c1f-b879-fbcbd9edc2a0 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:11.786547 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ab370581-389e-4c1f-b879-fbcbd9edc2a0 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1751 microversion: 2.1 time: 0.338963 May 16 19:00:11.787694 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 582/1134] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:11 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1751 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:00:12.806618 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-1ccc0e5d-1d52-4957-ba2c-a623b65909c6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:12.807305 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-1ccc0e5d-1d52-4957-ba2c-a623b65909c6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:12.814370 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1ccc0e5d-1d52-4957-ba2c-a623b65909c6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:12.814831 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1ccc0e5d-1d52-4957-ba2c-a623b65909c6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:12.815613 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1ccc0e5d-1d52-4957-ba2c-a623b65909c6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:12.816077 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-1ccc0e5d-1d52-4957-ba2c-a623b65909c6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:13.046720 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-1ccc0e5d-1d52-4957-ba2c-a623b65909c6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:13.059883 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-1ccc0e5d-1d52-4957-ba2c-a623b65909c6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1751 microversion: 2.1 time: 0.257333 May 16 19:00:13.060772 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 553/1135] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:12 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1751 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:14.078809 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-fb0f3656-d88f-478b-b673-19a3908a81a6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:14.079436 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-fb0f3656-d88f-478b-b673-19a3908a81a6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:14.093858 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fb0f3656-d88f-478b-b673-19a3908a81a6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:14.094512 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fb0f3656-d88f-478b-b673-19a3908a81a6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:14.095328 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fb0f3656-d88f-478b-b673-19a3908a81a6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:14.095872 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-fb0f3656-d88f-478b-b673-19a3908a81a6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:14.265419 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-fb0f3656-d88f-478b-b673-19a3908a81a6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:14.275540 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-fb0f3656-d88f-478b-b673-19a3908a81a6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1751 microversion: 2.1 time: 0.201979 May 16 19:00:14.282475 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 583/1136] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:14 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1751 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:15.294863 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-da2964d6-615c-4617-a890-6d1931f31bfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:15.295408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-da2964d6-615c-4617-a890-6d1931f31bfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:15.302097 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da2964d6-615c-4617-a890-6d1931f31bfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:15.302549 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da2964d6-615c-4617-a890-6d1931f31bfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:15.303360 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da2964d6-615c-4617-a890-6d1931f31bfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:15.303833 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-da2964d6-615c-4617-a890-6d1931f31bfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:15.453861 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-da2964d6-615c-4617-a890-6d1931f31bfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:15.463014 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-da2964d6-615c-4617-a890-6d1931f31bfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.172657 May 16 19:00:15.463588 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 554/1137] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:15 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:16.482173 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-7542e938-f0cf-4774-9b0a-0423a5e3adfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:16.482768 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-7542e938-f0cf-4774-9b0a-0423a5e3adfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:16.489267 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7542e938-f0cf-4774-9b0a-0423a5e3adfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:16.489723 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7542e938-f0cf-4774-9b0a-0423a5e3adfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:16.490502 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7542e938-f0cf-4774-9b0a-0423a5e3adfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:16.490940 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-7542e938-f0cf-4774-9b0a-0423a5e3adfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:16.638624 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-7542e938-f0cf-4774-9b0a-0423a5e3adfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:16.646821 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-7542e938-f0cf-4774-9b0a-0423a5e3adfc tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.169275 May 16 19:00:16.647397 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 584/1138] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:16 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:17.664633 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e0d77f1a-d747-4340-8232-8e4d9524511f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:17.665302 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e0d77f1a-d747-4340-8232-8e4d9524511f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:17.671774 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0d77f1a-d747-4340-8232-8e4d9524511f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:17.672229 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0d77f1a-d747-4340-8232-8e4d9524511f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:17.673301 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0d77f1a-d747-4340-8232-8e4d9524511f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:17.673540 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e0d77f1a-d747-4340-8232-8e4d9524511f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:17.820414 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e0d77f1a-d747-4340-8232-8e4d9524511f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:17.828919 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e0d77f1a-d747-4340-8232-8e4d9524511f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.168133 May 16 19:00:17.829496 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 555/1139] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:17 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:18.846500 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-c2101553-715d-49d2-83ee-83c0467245b8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:18.848526 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-c2101553-715d-49d2-83ee-83c0467245b8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:18.853856 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c2101553-715d-49d2-83ee-83c0467245b8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:18.854311 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c2101553-715d-49d2-83ee-83c0467245b8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:18.855139 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c2101553-715d-49d2-83ee-83c0467245b8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:18.855580 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-c2101553-715d-49d2-83ee-83c0467245b8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:19.001144 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-c2101553-715d-49d2-83ee-83c0467245b8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:19.009351 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-c2101553-715d-49d2-83ee-83c0467245b8 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.166786 May 16 19:00:19.009927 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 585/1140] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:18 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:20.028231 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3ce1b861-5ef8-4cf1-83f6-c3c3cb1eebc4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:20.029114 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-3ce1b861-5ef8-4cf1-83f6-c3c3cb1eebc4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:20.035553 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3ce1b861-5ef8-4cf1-83f6-c3c3cb1eebc4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:20.036042 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3ce1b861-5ef8-4cf1-83f6-c3c3cb1eebc4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:20.036832 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3ce1b861-5ef8-4cf1-83f6-c3c3cb1eebc4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:20.037268 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3ce1b861-5ef8-4cf1-83f6-c3c3cb1eebc4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:20.208716 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-3ce1b861-5ef8-4cf1-83f6-c3c3cb1eebc4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:20.217987 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3ce1b861-5ef8-4cf1-83f6-c3c3cb1eebc4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.194128 May 16 19:00:20.218892 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 556/1141] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:20 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:21.235964 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-6e22dcc7-7db3-4f47-8ff6-fa73aa3a1924 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:21.236545 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-6e22dcc7-7db3-4f47-8ff6-fa73aa3a1924 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:21.242772 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6e22dcc7-7db3-4f47-8ff6-fa73aa3a1924 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:21.243224 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6e22dcc7-7db3-4f47-8ff6-fa73aa3a1924 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:21.244013 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6e22dcc7-7db3-4f47-8ff6-fa73aa3a1924 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:21.244452 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-6e22dcc7-7db3-4f47-8ff6-fa73aa3a1924 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:21.395528 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-6e22dcc7-7db3-4f47-8ff6-fa73aa3a1924 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:21.404465 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-6e22dcc7-7db3-4f47-8ff6-fa73aa3a1924 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.172435 May 16 19:00:21.405079 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 586/1142] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:21 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:22.421588 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-65c94084-b6e2-49dd-a6b6-5e0acd7799c7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:22.422894 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-65c94084-b6e2-49dd-a6b6-5e0acd7799c7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:22.429775 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-65c94084-b6e2-49dd-a6b6-5e0acd7799c7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:22.430314 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-65c94084-b6e2-49dd-a6b6-5e0acd7799c7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:22.431100 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-65c94084-b6e2-49dd-a6b6-5e0acd7799c7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:22.431542 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-65c94084-b6e2-49dd-a6b6-5e0acd7799c7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:22.590404 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-65c94084-b6e2-49dd-a6b6-5e0acd7799c7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:22.598328 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-65c94084-b6e2-49dd-a6b6-5e0acd7799c7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.181340 May 16 19:00:22.599051 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 557/1143] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:22 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:23.616422 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-eb869086-e542-448b-8031-3bf1fec3f10a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:23.617242 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-eb869086-e542-448b-8031-3bf1fec3f10a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:23.623657 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eb869086-e542-448b-8031-3bf1fec3f10a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:23.624146 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eb869086-e542-448b-8031-3bf1fec3f10a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:23.624968 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eb869086-e542-448b-8031-3bf1fec3f10a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:23.625483 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-eb869086-e542-448b-8031-3bf1fec3f10a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:23.779202 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-eb869086-e542-448b-8031-3bf1fec3f10a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:23.786910 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-eb869086-e542-448b-8031-3bf1fec3f10a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.174666 May 16 19:00:23.787467 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 587/1144] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:23 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:00:24.803699 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-b407d88d-b73f-4b1d-bfc6-971a0e6849a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:24.804933 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-b407d88d-b73f-4b1d-bfc6-971a0e6849a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:24.811519 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b407d88d-b73f-4b1d-bfc6-971a0e6849a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:24.812016 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b407d88d-b73f-4b1d-bfc6-971a0e6849a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:24.812824 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b407d88d-b73f-4b1d-bfc6-971a0e6849a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:24.813565 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-b407d88d-b73f-4b1d-bfc6-971a0e6849a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:24.980600 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-b407d88d-b73f-4b1d-bfc6-971a0e6849a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:24.988952 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-b407d88d-b73f-4b1d-bfc6-971a0e6849a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.188950 May 16 19:00:24.989567 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 558/1145] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:24 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:26.006481 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ead88c8d-d919-4a61-b190-1428fa25ac37 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:26.007087 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ead88c8d-d919-4a61-b190-1428fa25ac37 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:26.014251 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ead88c8d-d919-4a61-b190-1428fa25ac37 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:26.014706 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ead88c8d-d919-4a61-b190-1428fa25ac37 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:26.015469 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ead88c8d-d919-4a61-b190-1428fa25ac37 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:26.015929 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ead88c8d-d919-4a61-b190-1428fa25ac37 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:26.156675 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ead88c8d-d919-4a61-b190-1428fa25ac37 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:26.164517 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ead88c8d-d919-4a61-b190-1428fa25ac37 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.161995 May 16 19:00:26.165082 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 588/1146] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:26 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:27.181179 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-e9893f6d-97f0-4e1e-87cd-7c119424d217 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:27.181782 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-e9893f6d-97f0-4e1e-87cd-7c119424d217 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:27.187993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e9893f6d-97f0-4e1e-87cd-7c119424d217 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:27.188378 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e9893f6d-97f0-4e1e-87cd-7c119424d217 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:27.189131 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e9893f6d-97f0-4e1e-87cd-7c119424d217 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:27.189562 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-e9893f6d-97f0-4e1e-87cd-7c119424d217 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:27.324738 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-e9893f6d-97f0-4e1e-87cd-7c119424d217 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:27.332455 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-e9893f6d-97f0-4e1e-87cd-7c119424d217 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.155260 May 16 19:00:27.333016 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 559/1147] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:27 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:28.349701 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-ae9262b9-0998-4adf-8c02-d152fbd2c2a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:28.350304 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-ae9262b9-0998-4adf-8c02-d152fbd2c2a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:28.357575 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae9262b9-0998-4adf-8c02-d152fbd2c2a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:28.358030 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae9262b9-0998-4adf-8c02-d152fbd2c2a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:28.358808 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae9262b9-0998-4adf-8c02-d152fbd2c2a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:28.359246 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-ae9262b9-0998-4adf-8c02-d152fbd2c2a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:28.503474 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-ae9262b9-0998-4adf-8c02-d152fbd2c2a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:28.514322 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-ae9262b9-0998-4adf-8c02-d152fbd2c2a7 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.168566 May 16 19:00:28.514918 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 589/1148] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:28 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:29.532431 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-eb0f00ac-18c3-4b74-9680-bc6fb25506c4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:29.533045 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-eb0f00ac-18c3-4b74-9680-bc6fb25506c4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:29.539434 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eb0f00ac-18c3-4b74-9680-bc6fb25506c4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:29.539938 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eb0f00ac-18c3-4b74-9680-bc6fb25506c4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:29.540702 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eb0f00ac-18c3-4b74-9680-bc6fb25506c4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:29.541141 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-eb0f00ac-18c3-4b74-9680-bc6fb25506c4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:29.685246 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-eb0f00ac-18c3-4b74-9680-bc6fb25506c4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:29.693171 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-eb0f00ac-18c3-4b74-9680-bc6fb25506c4 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.164601 May 16 19:00:29.693737 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 560/1149] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:29 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:30.709841 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-bf79d0ea-0d93-4576-be2e-b075288583b6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:30.710446 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-bf79d0ea-0d93-4576-be2e-b075288583b6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:30.717880 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf79d0ea-0d93-4576-be2e-b075288583b6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:30.718334 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf79d0ea-0d93-4576-be2e-b075288583b6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:30.719103 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf79d0ea-0d93-4576-be2e-b075288583b6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:30.719544 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-bf79d0ea-0d93-4576-be2e-b075288583b6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:30.869729 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-bf79d0ea-0d93-4576-be2e-b075288583b6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:30.878048 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-bf79d0ea-0d93-4576-be2e-b075288583b6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.172036 May 16 19:00:30.878614 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 590/1150] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:30 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:31.897084 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-49e1ada1-701b-4575-9a2b-00b01ee17cff tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:31.897689 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-49e1ada1-701b-4575-9a2b-00b01ee17cff tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:31.904264 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49e1ada1-701b-4575-9a2b-00b01ee17cff tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:31.904712 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49e1ada1-701b-4575-9a2b-00b01ee17cff tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:31.905469 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49e1ada1-701b-4575-9a2b-00b01ee17cff tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:31.905901 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-49e1ada1-701b-4575-9a2b-00b01ee17cff tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:32.053158 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-49e1ada1-701b-4575-9a2b-00b01ee17cff tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:32.062290 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-49e1ada1-701b-4575-9a2b-00b01ee17cff tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.169219 May 16 19:00:32.062865 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 561/1151] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:31 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:33.080009 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-dac6c8e5-a858-4b10-a2da-a8938201f1a2 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:33.080572 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-dac6c8e5-a858-4b10-a2da-a8938201f1a2 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:33.086859 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dac6c8e5-a858-4b10-a2da-a8938201f1a2 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:33.087317 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dac6c8e5-a858-4b10-a2da-a8938201f1a2 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:33.088149 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dac6c8e5-a858-4b10-a2da-a8938201f1a2 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:33.089079 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-dac6c8e5-a858-4b10-a2da-a8938201f1a2 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:33.232760 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-dac6c8e5-a858-4b10-a2da-a8938201f1a2 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:33.240471 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-dac6c8e5-a858-4b10-a2da-a8938201f1a2 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.164743 May 16 19:00:33.241028 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 591/1152] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:33 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:34.257976 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-8ffb2c19-3df6-4123-bbbd-006453b0f44d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:34.258511 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-8ffb2c19-3df6-4123-bbbd-006453b0f44d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:34.265329 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8ffb2c19-3df6-4123-bbbd-006453b0f44d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:34.265776 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8ffb2c19-3df6-4123-bbbd-006453b0f44d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:34.266539 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8ffb2c19-3df6-4123-bbbd-006453b0f44d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:34.266974 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-8ffb2c19-3df6-4123-bbbd-006453b0f44d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:34.405260 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-8ffb2c19-3df6-4123-bbbd-006453b0f44d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:34.413429 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-8ffb2c19-3df6-4123-bbbd-006453b0f44d tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.159431 May 16 19:00:34.413990 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 562/1153] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:34 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:35.431567 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8a3880c1-0f60-4bf9-a3bf-2cc8b116b28b tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:35.432239 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-8a3880c1-0f60-4bf9-a3bf-2cc8b116b28b tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:35.438343 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8a3880c1-0f60-4bf9-a3bf-2cc8b116b28b tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:35.438765 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8a3880c1-0f60-4bf9-a3bf-2cc8b116b28b tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:35.439549 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8a3880c1-0f60-4bf9-a3bf-2cc8b116b28b tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:35.439993 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-8a3880c1-0f60-4bf9-a3bf-2cc8b116b28b tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:35.603200 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-8a3880c1-0f60-4bf9-a3bf-2cc8b116b28b tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:35.612121 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8a3880c1-0f60-4bf9-a3bf-2cc8b116b28b tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1756 microversion: 2.1 time: 0.184431 May 16 19:00:35.612663 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 592/1154] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:35 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:36.629396 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-ed0cfb84-aeab-4380-8183-d665a0162b38 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:36.630011 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-ed0cfb84-aeab-4380-8183-d665a0162b38 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:00:36.636706 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ed0cfb84-aeab-4380-8183-d665a0162b38 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:36.637171 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ed0cfb84-aeab-4380-8183-d665a0162b38 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:36.637941 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ed0cfb84-aeab-4380-8183-d665a0162b38 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:00:36.638377 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-ed0cfb84-aeab-4380-8183-d665a0162b38 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:00:36.780668 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-ed0cfb84-aeab-4380-8183-d665a0162b38 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:00:36.788373 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-ed0cfb84-aeab-4380-8183-d665a0162b38 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1759 microversion: 2.1 time: 0.162854 May 16 19:00:36.788950 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 563/1155] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:00:36 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:01:09.898441 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-0cdd7cf6-9c92-4cd3-8d11-eafeddaa2799 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1100682165"}} {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:09.899077 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-0cdd7cf6-9c92-4cd3-8d11-eafeddaa2799 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:01:09.905536 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0cdd7cf6-9c92-4cd3-8d11-eafeddaa2799 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:09.905989 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0cdd7cf6-9c92-4cd3-8d11-eafeddaa2799 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:09.906750 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0cdd7cf6-9c92-4cd3-8d11-eafeddaa2799 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:09.907184 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-0cdd7cf6-9c92-4cd3-8d11-eafeddaa2799 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:10.036085 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.network.security_group_api [None req-0cdd7cf6-9c92-4cd3-8d11-eafeddaa2799 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Removing security group 30bba3fa-194d-4b6b-ad9d-057a797e6354 from port 76aa757e-a54c-46e1-807c-5b28a26b7b88 May 16 19:01:10.409356 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-0cdd7cf6-9c92-4cd3-8d11-eafeddaa2799 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "POST /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/action" status: 202 len: 0 microversion: 2.1 time: 0.514355 May 16 19:01:10.420770 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-429224e0-beae-4bd9-b684-c8570086e572 req-2c797ca3-8922-489d-88b6-e365b7261496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03f3b05-1fdd-452d-b3d1-a15c908c83e8", "tag": "76aa757e-a54c-46e1-807c-5b28a26b7b88"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:10.421945 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 593/1156] 10.222.0.72 () {60 vars in 1277 bytes} [Mon May 16 19:01:09 2022] POST /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:01:10.434115 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-429224e0-beae-4bd9-b684-c8570086e572 req-2c797ca3-8922-489d-88b6-e365b7261496 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:10.434700 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-429224e0-beae-4bd9-b684-c8570086e572 req-2c797ca3-8922-489d-88b6-e365b7261496 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:10.451944 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-429224e0-beae-4bd9-b684-c8570086e572 req-2c797ca3-8922-489d-88b6-e365b7261496 service nova] Creating event network-changed:76aa757e-a54c-46e1-807c-5b28a26b7b88 for instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 on hv-cinder-75078 May 16 19:01:10.468438 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-429224e0-beae-4bd9-b684-c8570086e572 req-2c797ca3-8922-489d-88b6-e365b7261496 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051503 May 16 19:01:10.471078 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 564/1157] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 19:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:11.868199 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-12141ad7-dc37-470e-82a5-9176ac46cd30 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:11.868743 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-12141ad7-dc37-470e-82a5-9176ac46cd30 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:01:11.870447 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-c8d8c6c5-8e80-4d49-81b7-e2fc83cbb248 req-e2c0aee8-4604-48de-b39f-dc4c6d65581e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03f3b05-1fdd-452d-b3d1-a15c908c83e8", "tag": "76aa757e-a54c-46e1-807c-5b28a26b7b88"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:11.875638 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-12141ad7-dc37-470e-82a5-9176ac46cd30 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:11.876188 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-12141ad7-dc37-470e-82a5-9176ac46cd30 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:11.877041 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-12141ad7-dc37-470e-82a5-9176ac46cd30 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:11.877567 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-12141ad7-dc37-470e-82a5-9176ac46cd30 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:11.879969 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-c8d8c6c5-8e80-4d49-81b7-e2fc83cbb248 req-e2c0aee8-4604-48de-b39f-dc4c6d65581e service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:11.880601 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-c8d8c6c5-8e80-4d49-81b7-e2fc83cbb248 req-e2c0aee8-4604-48de-b39f-dc4c6d65581e service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:11.893041 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-c8d8c6c5-8e80-4d49-81b7-e2fc83cbb248 req-e2c0aee8-4604-48de-b39f-dc4c6d65581e service nova] Creating event network-changed:76aa757e-a54c-46e1-807c-5b28a26b7b88 for instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 on hv-cinder-75078 May 16 19:01:11.898408 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-c8d8c6c5-8e80-4d49-81b7-e2fc83cbb248 req-e2c0aee8-4604-48de-b39f-dc4c6d65581e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032839 May 16 19:01:11.899092 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 565/1158] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 19:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:11.973560 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-12141ad7-dc37-470e-82a5-9176ac46cd30 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lazy-loading 'services' on Instance uuid c03f3b05-1fdd-452d-b3d1-a15c908c83e8 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:01:12.059586 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-12141ad7-dc37-470e-82a5-9176ac46cd30 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments/c980e45b-1481-48cd-a646-20bfe3b51d5d" status: 202 len: 0 microversion: 2.1 time: 0.196276 May 16 19:01:12.060364 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 594/1159] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 19:01:11 2022] DELETE /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments/c980e45b-1481-48cd-a646-20bfe3b51d5d => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:01:12.070852 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3886a490-252f-46ff-af74-8a6dd29f9e40 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:12.071991 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-3886a490-252f-46ff-af74-8a6dd29f9e40 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:01:12.078922 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3886a490-252f-46ff-af74-8a6dd29f9e40 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:12.079452 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3886a490-252f-46ff-af74-8a6dd29f9e40 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:12.080675 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3886a490-252f-46ff-af74-8a6dd29f9e40 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:12.080866 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3886a490-252f-46ff-af74-8a6dd29f9e40 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:12.113841 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3886a490-252f-46ff-af74-8a6dd29f9e40 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047594 May 16 19:01:12.118527 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 566/1160] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 19:01:12 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:13.127502 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-08a3d4d6-61b2-40e6-9e11-62067db6c801 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:13.128770 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-08a3d4d6-61b2-40e6-9e11-62067db6c801 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:01:13.136101 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08a3d4d6-61b2-40e6-9e11-62067db6c801 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:13.136646 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08a3d4d6-61b2-40e6-9e11-62067db6c801 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:13.137448 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08a3d4d6-61b2-40e6-9e11-62067db6c801 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:13.137885 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-08a3d4d6-61b2-40e6-9e11-62067db6c801 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:13.168952 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-08a3d4d6-61b2-40e6-9e11-62067db6c801 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046647 May 16 19:01:13.169510 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 595/1161] 10.222.0.72 () {58 vars in 1301 bytes} [Mon May 16 19:01:13 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:01:13.179236 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-077942c3-55da-4791-bf2e-84a10c3395b5 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:13.179794 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-077942c3-55da-4791-bf2e-84a10c3395b5 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:01:13.187123 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-077942c3-55da-4791-bf2e-84a10c3395b5 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:13.187577 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-077942c3-55da-4791-bf2e-84a10c3395b5 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:13.188373 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-077942c3-55da-4791-bf2e-84a10c3395b5 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:13.188815 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-077942c3-55da-4791-bf2e-84a10c3395b5 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:13.263016 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-077942c3-55da-4791-bf2e-84a10c3395b5 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] HTTP exception thrown: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 is not attached to volume c980e45b-1481-48cd-a646-20bfe3b51d5d May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-077942c3-55da-4791-bf2e-84a10c3395b5 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Request method failure captured: May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: DELETE /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments/c980e45b-1481-48cd-a646-20bfe3b51d5d HTTP/1.1 May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigp7jSBw2U393B2N9pZy2Rz37R2SbKZMouIoQ7kehalWBnfULoeCo1CI2DEbSB6QQ4mFT73bJJ3kEQ7u1loKVfwflsRtTlEpeDfpbjxTT7YdDGZ7JGzur4-rBRTS0MQwAphDaSQZ_tmvVv1qirZb6YkC8jOyTMdT5EqZoE_p255opYBo May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: bb467769134a4df0bb4608a8283e8dda May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-TestMinimumBasicScenario-1967975736 May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 19:01:13.272802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bb467769134a4df0bb4608a8283e8dda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb467769134a4df0bb4608a8283e8dda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb467769134a4df0bb4608a8283e8dda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bb467769134a4df0bb4608a8283e8dda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-TestMinimumBasicScenario-1967975736 May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: bb467769134a4df0bb4608a8283e8dda May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1967975736 May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-TestMinimumBasicScenario-1967975736-project May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 0bacbe5d174842debcc440335a91659d May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-TestMinimumBasicScenario-1967975736-project May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 19:01:13.274639 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 is not attached to volume c980e45b-1481-48cd-a646-20bfe3b51d5d May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'server_id': 'c03f3b05-1fdd-452d-b3d1-a15c908c83e8', 'id': 'c980e45b-1481-48cd-a646-20bfe3b51d5d'} May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c980e45b-1481-48cd-a646-20bfe3b51d5d. May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:01:13.275443 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 is not attached to volume c980e45b-1481-48cd-a646-20bfe3b51d5d May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 is not attached to volume c980e45b-1481-48cd-a646-20bfe3b51d5d May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:01:13.276871 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-077942c3-55da-4791-bf2e-84a10c3395b5 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Returning 404 to user: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 is not attached to volume c980e45b-1481-48cd-a646-20bfe3b51d5d {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:01:13.277914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-077942c3-55da-4791-bf2e-84a10c3395b5 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments/c980e45b-1481-48cd-a646-20bfe3b51d5d" status: 404 len: 154 microversion: 2.1 time: 0.099091 May 16 19:01:13.277914 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 567/1162] 10.222.0.72 () {58 vars in 1415 bytes} [Mon May 16 19:01:13 2022] DELETE /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8/os-volume_attachments/c980e45b-1481-48cd-a646-20bfe3b51d5d => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:01:14.409322 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-16d70a03-8f48-459a-956e-a1fce2c426bd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:14.409886 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-16d70a03-8f48-459a-956e-a1fce2c426bd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:01:14.416025 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16d70a03-8f48-459a-956e-a1fce2c426bd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:14.416477 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16d70a03-8f48-459a-956e-a1fce2c426bd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:14.417876 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16d70a03-8f48-459a-956e-a1fce2c426bd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:14.418564 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-16d70a03-8f48-459a-956e-a1fce2c426bd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:14.442660 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-16d70a03-8f48-459a-956e-a1fce2c426bd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Going to try to terminate instance {{(pid=128886) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:01:14.518790 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-16d70a03-8f48-459a-956e-a1fce2c426bd tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 204 len: 0 microversion: 2.1 time: 0.112500 May 16 19:01:14.519483 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 596/1163] 10.222.0.72 () {58 vars in 1238 bytes} [Mon May 16 19:01:14 2022] DELETE /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:01:14.528364 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-0984c72c-3f89-441e-95f4-dd9b0226ea0a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:14.529056 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-0984c72c-3f89-441e-95f4-dd9b0226ea0a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:01:14.536802 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0984c72c-3f89-441e-95f4-dd9b0226ea0a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:14.537266 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0984c72c-3f89-441e-95f4-dd9b0226ea0a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:14.538050 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0984c72c-3f89-441e-95f4-dd9b0226ea0a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:14.538490 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-0984c72c-3f89-441e-95f4-dd9b0226ea0a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:14.679838 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.policy [None req-0984c72c-3f89-441e-95f4-dd9b0226ea0a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128887) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:01:14.687830 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-0984c72c-3f89-441e-95f4-dd9b0226ea0a tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1553 microversion: 2.1 time: 0.164141 May 16 19:01:14.688400 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 568/1164] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:01:14 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:01:15.706544 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-f710f507-30c3-4dfe-bde1-fdb47c85956f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:15.707255 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-f710f507-30c3-4dfe-bde1-fdb47c85956f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:01:15.713778 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f710f507-30c3-4dfe-bde1-fdb47c85956f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:15.714542 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f710f507-30c3-4dfe-bde1-fdb47c85956f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:15.715441 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f710f507-30c3-4dfe-bde1-fdb47c85956f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:15.715923 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-f710f507-30c3-4dfe-bde1-fdb47c85956f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:15.849405 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-f710f507-30c3-4dfe-bde1-fdb47c85956f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:01:15.857478 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-f710f507-30c3-4dfe-bde1-fdb47c85956f tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1553 microversion: 2.1 time: 0.155236 May 16 19:01:15.858059 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 597/1165] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:01:15 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:01:16.718861 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [req-9c34601a-49e1-40b1-a949-b522dd827308 req-d6090560-c15c-48b2-8a5e-0799d2c1c504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03f3b05-1fdd-452d-b3d1-a15c908c83e8", "name": "network-vif-deleted", "tag": "76aa757e-a54c-46e1-807c-5b28a26b7b88"}]} {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:16.727672 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-9c34601a-49e1-40b1-a949-b522dd827308 req-d6090560-c15c-48b2-8a5e-0799d2c1c504 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:16.728146 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [req-9c34601a-49e1-40b1-a949-b522dd827308 req-d6090560-c15c-48b2-8a5e-0799d2c1c504 service nova] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:16.741578 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.compute.server_external_events [req-9c34601a-49e1-40b1-a949-b522dd827308 req-d6090560-c15c-48b2-8a5e-0799d2c1c504 service nova] Creating event network-vif-deleted:76aa757e-a54c-46e1-807c-5b28a26b7b88 for instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 on hv-cinder-75078 May 16 19:01:16.747419 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [req-9c34601a-49e1-40b1-a949-b522dd827308 req-d6090560-c15c-48b2-8a5e-0799d2c1c504 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033059 May 16 19:01:16.748215 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 569/1166] 10.222.0.72 () {64 vars in 1317 bytes} [Mon May 16 19:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:16.875137 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:16.875784 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.compute.api [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128886) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:01:16.882216 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:16.882656 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:16.883425 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:16.883898 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:16.916779 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:16.919647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG oslo_concurrency.lockutils [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:16.919647 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.objects.instance [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lazy-loading 'fault' on Instance uuid c03f3b05-1fdd-452d-b3d1-a15c908c83e8 {{(pid=128886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:01:16.963564 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.policy [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bacbe5d174842debcc440335a91659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb467769134a4df0bb4608a8283e8dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128886) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:01:16.971931 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-1075af69-788c-4a9f-a54b-7060255699f6 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 200 len: 1348 microversion: 2.1 time: 0.101306 May 16 19:01:16.972513 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 598/1167] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:01:16 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:01:17.990425 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3414b0e9-fcc8-45a7-9eae-9f7a007f6d91 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '>' {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:17.991122 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.compute.api [None req-3414b0e9-fcc8-45a7-9eae-9f7a007f6d91 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] [instance: c03f3b05-1fdd-452d-b3d1-a15c908c83e8] Fetching instance by UUID {{(pid=128887) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:01:17.997462 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3414b0e9-fcc8-45a7-9eae-9f7a007f6d91 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:17.997915 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3414b0e9-fcc8-45a7-9eae-9f7a007f6d91 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:17.998679 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3414b0e9-fcc8-45a7-9eae-9f7a007f6d91 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:01:17.999116 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG oslo_concurrency.lockutils [None req-3414b0e9-fcc8-45a7-9eae-9f7a007f6d91 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Lock "84d05d0b-ae3d-4239-a9ae-52dba225be17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:01:18.011993 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.wsgi [None req-3414b0e9-fcc8-45a7-9eae-9f7a007f6d91 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] HTTP exception thrown: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 could not be found. May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3414b0e9-fcc8-45a7-9eae-9f7a007f6d91 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Request method failure captured: May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: request: GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 HTTP/1.1 May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept: application/json May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Accept-Encoding: identity May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Connection: close May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Length: 0 May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Content-Type: application/json May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Host: 10.222.0.72 May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Openstack-System-Scope: None May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: User-Agent: python-urllib3/1.26.9 May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Auth-Token: gAAAAABigp7jSBw2U393B2N9pZy2Rz37R2SbKZMouIoQ7kehalWBnfULoeCo1CI2DEbSB6QQ4mFT73bJJ3kEQ7u1loKVfwflsRtTlEpeDfpbjxTT7YdDGZ7JGzur4-rBRTS0MQwAphDaSQZ_tmvVv1qirZb6YkC8jOyTMdT5EqZoE_p255opYBo May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Id: None May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Domain-Name: None May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Identity-Status: Confirmed May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Is-Admin-Project: True May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Id: default May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Domain-Name: Default May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Id: bb467769134a4df0bb4608a8283e8dda May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Project-Name: tempest-TestMinimumBasicScenario-1967975736 May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Role: reader,member May 16 19:01:18.013590 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Roles: reader,member May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bb467769134a4df0bb4608a8283e8dda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb467769134a4df0bb4608a8283e8dda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb467769134a4df0bb4608a8283e8dda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bb467769134a4df0bb4608a8283e8dda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant: tempest-TestMinimumBasicScenario-1967975736 May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Id: bb467769134a4df0bb4608a8283e8dda May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1967975736 May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User: tempest-TestMinimumBasicScenario-1967975736-project May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Id: default May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Domain-Name: Default May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Id: 0bacbe5d174842debcc440335a91659d May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: X-User-Name: tempest-TestMinimumBasicScenario-1967975736-project May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: method: > May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: exception: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 could not be found. May 16 19:01:18.015225 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: action_args: {'id': 'c03f3b05-1fdd-452d-b3d1-a15c908c83e8'} May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: {{(pid=128887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 could not be found. May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:01:18.016267 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 could not be found. May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 could not be found. May 16 19:01:18.017848 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: ERROR nova.api.openstack.wsgi May 16 19:01:18.019316 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: DEBUG nova.api.openstack.wsgi [None req-3414b0e9-fcc8-45a7-9eae-9f7a007f6d91 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Returning 404 to user: Instance c03f3b05-1fdd-452d-b3d1-a15c908c83e8 could not be found. {{(pid=128887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:01:18.019316 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO nova.api.openstack.requestlog [None req-3414b0e9-fcc8-45a7-9eae-9f7a007f6d91 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8" status: 404 len: 111 microversion: 2.1 time: 0.029207 May 16 19:01:18.019316 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: [pid: 128887|app: 0|req: 570/1168] 10.222.0.72 () {58 vars in 1235 bytes} [Mon May 16 19:01:17 2022] GET /compute/v2.1/servers/c03f3b05-1fdd-452d-b3d1-a15c908c83e8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:01:18.023683 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: DEBUG nova.api.openstack.wsgi [None req-8a3e6d1a-6c92-41a9-ba68-bd27307627e3 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] Calling method '.version_select at 0x7f645be77670>' {{(pid=128886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:18.041570 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO nova.api.openstack.requestlog [None req-8a3e6d1a-6c92-41a9-ba68-bd27307627e3 tempest-TestMinimumBasicScenario-1967975736 tempest-TestMinimumBasicScenario-1967975736-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1523465501" status: 202 len: 0 microversion: 2.1 time: 0.021751 May 16 19:01:18.042744 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: [pid: 128886|app: 0|req: 599/1169] 10.222.0.72 () {58 vars in 1271 bytes} [Mon May 16 19:01:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1523465501 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:01:22.584544 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:01:22.585107 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Mon May 16 19:01:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:01:57.334328 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:01:57.334944 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Mon May 16 19:01:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:02:19.514564 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:02:19.515210 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Mon May 16 19:02:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:03:42.544661 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:03:42.545267 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Mon May 16 19:03:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:03:57.273666 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:03:57.274390 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Mon May 16 19:03:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:04:22.321638 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:04:22.322292 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Mon May 16 19:04:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:04:42.593052 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:04:42.593707 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Mon May 16 19:04:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:05:17.343571 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:05:17.344225 dv-cinder-750782-22-iscsi devstack@n-api.service[128886]: Mon May 16 19:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:05:39.522797 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:05:39.523431 dv-cinder-750782-22-iscsi devstack@n-api.service[128887]: Mon May 16 19:05:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!